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FOREWORD 


To  ensure  that  the  U.S.  Army's  future  weapon  systems  are  useable  by  our 
soldiers,  the  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences 
(ARI)  performs  behavioral  research  to  provide  guidelines  and  specifications 
for  matching  equipment  designs  with  soldier  capabilities  and  limitations. 
Within  the  ARI  Field  Unit  at  Fort  Knox,  the  Future  Battlefield  Conditions 
Team  conducts  applied  research  to  enhance  soldier  preparedness  through  iden¬ 
tification  of  future  weapon  systems  and  the  methods  for  training  to  meet 
future  battlefield  conditions. 

This  report  provides  system  designers  with  a  preliminary  set  of  user 
interface  requirements  for  the  new  main  tank's  (Ml A1 )  battlefield  management 
system  (BMS).  BMS  is  an  Integrated  complex  of  battlefield  information  acqui¬ 
sition  and  processing  technologies  intended  to  significantly  enhance  command 
and  control  (C2). 

Future  development  of  the  user  requirements  identified  in  this  report 
will  lead  to  the  design  and  production  of  a  BMS  that  will  not  only  enhance  C2 
and  battlefield  communications  but  also  significantly  reduce  the  small  unit 
leader’s  workload. 
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USER  INTERFACE  REQUIREMENTS  FOR  BATTLEFIELD  MANAGEMENT  SYSTEMS  ( BMS) 


EXECUTIVE  SUMMARY 


Requirement: 

To  ensure  that  user  interface  requirements  were  included  in  the  design 
and  development  of  the  MlAl's  Block  II  primary  modification,  the  Battlefield 
Management  System. 


Procedure : 

A  prototype  BMS  interface  was  designed  and  developed  on  an  Integrated 
Raste-  Imaging  System  (IRIS).  A  cross-section  of  small  unit  leaders  worked 
with  a  digitized  terrain  data  base  of  the  Fulda  Gap  and  menu-structured  re¬ 
port  functions  to  construct  and  edit  the  map  displays  and  tactical  reports 
needed  for  their  respective  duty  positions. 

User  requirements  were  obtained  by  means  of  a  structured  questionnaire 
that  addressed  each  of  the  following  features  and  functions  anticipated  for 
BMS:  terrain  map  and  tactical  cverlays,  variable  menu  for  reports  and  mes¬ 
sages,  response  keys,  warnings  and  alerts,  input  devices  and  radio  communi¬ 
cations.  In  addition  a  protocol  record  was  maintained  of  all  users'  comments 
and  recommendations. 


Findings : 

Because  of  the  relatively  compressed  area  anticipated  for  BMS  map  dis¬ 
plays,  users  specified  the  need  for  a  variety  of  map  I'eatures  and  functions 
that  allow  users  to  tailor  the  map  to  their  immediate  task  requirements.  Re¬ 
quirements  included  the  following:  selection  and  deletion  c  both  man-made  and 
natural  terrain  features  and  operational  overlays,  discret'-  scale  functions 
that  resolve  to  the  user's  immediate  area  of  Interest,  and  redundant  picture 
and  symbol  features  for  control  measures  and  overlays.  Structured  menus  appear 
promising  for  automated  function.  A  number  of  menu  modifications  were  pro¬ 
posed  including  the  need  to  integrate  map  and  report  functions  to  reduce  user 
report  requirements.  User  requirements  for  overall  configuration,  size,  and 
operating  characteristics  of  the  BMS  interface  were  identified. 


Utilization  of  Findings: 

The  findings  of  this  research  effort  were  provided  to  the  Project  Manager 
of  M1A1  Block  II  by  the  U.S.  Army  Armor  Center's  Directorate  of  Combat  Devel¬ 
opments.  Future  development  of  these  requirements  will  lead  to  the  design  and 
production  of  a  BMS  interface  that  will  not  only  enhance  command  and  control, 
but  also  significantly  reduce  the  small  unit  leader's  workload. 
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INTRODUCTION 


The  Army  Research  Institute  (ARI)  conduota  applied  researoh  that  foouses 
on  meeting  the  people-related  challenges  faolng  the  Army  of  today  and  tomor¬ 
row.  As  part  of  ARI'a  program  to  train  the  foroe,  the  objective  of  the  Fu¬ 
ture  Battlefield  Conditions  Team  is  to  enhanoe  soldier  preparedness  through 
identifloation  of  future  battlefield  oonditiona  and  the  methods  for  training 
to  meet  those  oonditiona  (Soienoe  and  Technology  Task  3.5.1).  Future  ad¬ 
vances  in  weapons  and  equipment  of  the  US  Army,  however,  oan  inorease  our 
oombat  effectiveness  only  if  those  systems  are  usable  by  our  soldiers.  To 
ensure  that  future  weapon  systems  are  useable,  ARI  oonduots  behavioral  re¬ 
searoh  to  provide  guidelines  and  speolfioatlons  for  matohing  equipment  de¬ 
signs  with  soldier  oapabilitles  and  limitations.  This  ARI  researoh  produot 
provides  system  designers  with  a  preliminary  set  of  user  interfaoe  require¬ 
ments  for  the  new  main  battle  tank's  battlefield  management  system  (BMS). 

BMS  is  an  integrated  oomplex  of  battlefield  information  acquisition  and 
prooessing  technologies  intended  to  slgnifioantly  enhanoe  oombat  vehiole 
oommand  and  oontrol  (Cz).  As  the  proponent  of  Armor  and  BMS,  the  US  Army 
Armor  Center's  (USAARMC)  Directorate  of  Combat  Developments  (DCD)  has  con¬ 
ducted  a  series  of  evaluations  on  BMS  prototype  systems  to  ensure  that  user 
requirements  will  be  included  in  the  design  and  development  of  M1A1  BMS.  One 
effort  within  this  series  of  evaluations,  the  Block  I  BMS  evaluation,  identi¬ 
fied  the  user  informational  requirements  for  command  and  oontrol  with  respect 
to  mission  accomplishment.  As  part  of  the  current  Blook  II  BMS  evaluation, 
this  report  identified  the  user  interfaoe  requirements  with  prototype  BMS 
display  features  and  oontrol  funotiona.  The  findings  of  this  researoh  effort 
were  provided  to  DCD  by  ARI  in  September  '85  and  served  as  the  oorneratone 
for  DCD' a  final  report  on  BMS  user  interface  requirements  provided  to  the 
Projeot  Manger  (PM)  of  the  M1A1  Block  II.  Future  researoh  efforts  are  ex¬ 
pected  to  identify  the  interactive  requirements  for  BMS. 

To  obtain  an  informed  set  of  human  factor  guidelines  for  a  first-genera¬ 
tion  system  deoign,  users  must  have  the  opportunity  to  directly  use  and  eval¬ 
uate  the  system's  features  and  functions  before  the  system  is  developed  and 
produced.  To  provide  DCD  a  prototype  model  of  BMS  display  panels  and  oontrol 
functions  the  Lockheed  Corporation,  working  with  independent  research  and  de¬ 
velopment  funds  (IR4D),  joined  this  research  effort.  Lookheed,  developed  a 
reconflgurable,  display  demonstrator  to  simulate  and  test  an  array  of  antici¬ 
pated  BMS  display  and  control  features  and  functions. 

The  findings  presented  in  this  report  on  user  interfaoe  requirements  for 
BMS  are  the  result,  therefore,  of  a  Joint  effort  by  DCD,  ARI  and  the  Lookheed 
Corporation,  This  effort  was  driven  by  DCD's  requirement  to  determine  guide¬ 
lines  and  specifications  for  BMS  production  design.  Although  the  battlefield 
management  system  comprises  a  host  or'  interrelated  technologies,  for  the  sake 
of  brevity  the  BMS  acronym  will  be  used  throughout  this  report  which  is  con¬ 
cerned  primarily  with  the  user  interface  with  BMS,  the  BMS  display  features 
and  control  functions. 
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BMS  INTERFACE  PROTOTYPE 


Design  of  Interfaoe 

The  BMS  prototype  under  evaluation  was  developed  by  the  Lookheed  Corpo¬ 
ration  and  used  a  1400  IRIS  (Integrated  Raster  Imaging  System)  computer.  The 
IRIS  was  used  to  generate  all  BMS  display  features  and  oontrol  funotions.  The 
IRIS  oomputer  wan  seleoted  as  the  BMS  simulator  beoause  it  is  a  high  perform¬ 
ance,  high  resolution  oolor  oomputing  system  for  2  dimensional  and  3  dimen¬ 
sional  oomputer  graphios.  As  a  display  simulator  the  IRIS  is  a  powerful 
system  for  generating  and  rapidly  reconfiguring  display  and  oontrol  features. 
This  graphlo  capability  is  ideal  for  quiokly  redesigning  and  evaluating  in¬ 
terface  features  and  funotions  in  response  to  users'  recommendations  and  re¬ 
quirements.  IRIS's  ability  to  oommunloate  with  other  terminals  (either 
through  an  Ethernet  or  an  RS-232  serial  line)  woul^  also  support  the  evalua¬ 
tion  of  interaotive  requirements,  oritioal  for  enhancing  oommand  and  oontrol. 
Future  researoh  efforts  are  expeoted  to  focus  both  on  (1)  behavioral  measures 
of  BMS 's  potential  for  reduolng  the  users'  workload  and  (2)  the  real-time 
processing  and  transmission  of  battlefield  Information. 

The  BMS  base  display  evaluated  was  generated  on  the  IRIS's  23  inoh  (5.8 
dm),  high-resolution  monitor.  This  display  oould  be  projected  in  oolor  or 
blaok  and  white,  and  at  eaah  of  the  following  sizes:  7  inoh  (1.8  dm),  8  inoh 
(2.0  dm),  9  inoh  (2.28  dm).  The  overall  reotangular  display  region  was 
partitioned  into  five  "windows"  or  display  areas  corresponding  to  the  follow¬ 
ing  BMS  funotions:  terrain  map,  variable  menu,  messages/warnings,  time/date 
and  dedioated  keys.  Figure  1  depiots  the  relative  layout  of  these  display 
areas.  All  window  locations  and  relative  display  areas  remained  constant 
throughout  this  investigation.  Users'  interactions  with  all  display  features 
and  funotions  were  input  by  means  of  a  tethered  trackball  and  mouse  devioe. 
The  following  seotion  desoribes  the  BMS  display  features  and  oontrol  funo¬ 
tions  developed  and  assessed  during  this  evaluation. 


Description  of  Interfaoe 

The  terrain  depicted  in  the  BMS  map  display  window  was  generated  from 
Digital  Terrain  Elevation  Data  (DTED)  Level  I  produoed  by  the  Defense  Mapping 
Agenoy  (DMA).  The  area  displayed  was  a  30  x  30  km  region  in  the  Fulda  Gap 
along  the  East/West  German  border.  Terrain  and  map  features  suoh  as  roads, 
towns,  vegetation,  grid  and  contour  lines  oould  be  individually  added  to  or 
deleted  from  this  map  by  way  of  menu  selections  (see  Figure  1).  In  addition 
a  limited  set  of  graphlo  control  measures  suoh  as  oheokpoints  and  tanks  oould 
be  annotated  onto  the  map  area  by  either  menu  selections  or  a  free  draw  func¬ 
tion.  Users  were  able  to  zoom  in  to  foous  on  smaller  topographloal  areas 
within  the  overall  map  display  region  by  key  and  menu  selections  that  acti¬ 
vated  zoom,  scroll  and  centering  functions. 

The  variable  menu  area  provided  users  different  menus  and  supporting 
submenus  for  each  of  the  main  menu  function  keys.  In  Figure  2,  for  example, 
by  pressing  the  "MAP"  key  the  user  has  called-up  the  submenu  of  man-made  and 
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Figure  1.  BMS  base  display  depicting  30  km  region  in  the  Fulda 
Gap  (a  =  map  display;  b  =  automatic  function  keys; 
c  s  main  menu  keys;  d  =  map  scale  and  movement  keys; 
e  =  variable  menu  display;  f  =  message  display;  and 
g  =  date  and  time  display) . 


natural  features  and  then  selected  five  (5)  of  these  features  for  the  map 
display.  Similarly  this  variable  menu  area  served  as  the  display  window  for 
composing  and  editing  a  variety  of  reports  (e.g.,  SPOT,  SHELL  SITREP).  By 
activating  the  "REPORTS”  key,  in  the  dedicated  key  window  at  the  bottom  of 
the  base  display,  the  user  could  call-up  the  menu-structured  options  for 
composing  a  new  report  or  for  modifying  a  report  previously  constructed.  As 
an  example  of  the  menu-structures  tested  in  this  evaluation,  the  response 
options  and  sequence  of  pages  for  composing  or  editing  a  report  are  depicted 
in  Figure  3.  The  software  developed  for  this  evaluation  then  presented  users 
a  menu  list  of  different  reports  from  which  the,  user  would  select  the  type  of 
report  he  elected  to  compose.  The  actual  "composition"  was  accomplished  by 
users  selecting  the  appropriate  informational  elements  from  a  series  of  menu 
lists  or  "pages".  For  example,  on  a  subsequent  page  of  a  SPOT  REPORT  the 
user  would  designate  the  type  of  enemy  threat  being  reported  (e.g.,  ARTY, 
TANK,  ATGM).  Each  menu  page  was  clearly  titled  and  included  prompts  or  mes¬ 
sages  to  ensure  that  users  understood  the  required  input. 
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BMS  base  display  depioting  5 +  km  region,  in  the  Fulda  Gap 
and  subset  of  5  features  seleoted  for  map  display;  user's 
seleotions  indioated  by  reverse  video  (original  display 
in  color  and  blaok/white) . 


After  completing  a  report  the  user  was  provided  a  summary  page  that 
provided  a  quiok  review  of  all  the  information  selected.  The  user  could  then 
edit  or  oorreot  this  final  report  before  "transmitting"  it  to  other  battle¬ 
field  management  systems.  Actual  transmissions  of  rsports  and  messages  to 
other  users  were  not  made  during  this  evaluation.  When  the  BMS  prototype  is 
upgraded  for  interactive  oommand  and  oontrol  requirements  incoming  reports 
are  expected  to  be  presented  in  the  same  variable  menu  area  used  for  compos¬ 
ing  and  editing  reports.  The  display  window  labeled  "g"  in  Figure  1  was 
inoluded  on  the  base  display  as  a  designated  area  for  alerting  or  cueing 
users  that  incoming  messages  (e.g.,  alerts,  reports,  orders)  were  being 
transmitted  by  other  units.  Finally,  the  remaining  display  area  included  in 
the  base  prototype  was  the  date  and  time  data  provided  at  the  upper  right 
corner  of  the  display.  For  the  initial  prototype  evaluation  this  information 
was  provided  in  a  digital  date/time  format. 
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Figure  3.  Menu-structure  and  response  options  for  composing  or  editing  a 
report  (the  >/  indicates  user's  selections  for  a  typical  SPOT 
report,  and  the  *  denotes  that  user  selections  for  identifying 
enemy  location  were  not  operational  for  this  evaluation). 
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The  base  display  also  included  an  area  at  the  bottom  of  the  display  for 
a  row  of  dedicated  or  permanent  function  keys.  The  actual  layout  of  these 
keys  and  their  respective  labels  are  depicted  in  Figure  1.  All  of  these  keys 
were  "soft"  keys  that  the  user  activated  by  moving  the  cursor  onto  the  de¬ 
sired  key  with  the  trackball  and  then  entering  his  aeleotlon  by  pressing  the 
mouse  button.  The  five  square  keys  served  as  menu  entry  points  to  in 
itialize  or  oall-up  the  main  menus  for  a  number  of  primary  BMS  functions  as 
described  previously.  The  hexagonal  keys  at  the  right  of  this  window  allowed 
the  user  to  call-up  submenus  to  zoom,  soroll  and  oenter  the  digitized  terrain 
map  as  required.  The  thren  round  keys  at  the  left  of  this  region,  were 
designed  for  rapid  exeoutioo  of  critioal  tasks  (l.e.,  contaot  reports,  oall 
for  fire,  and  nuclear,  biologioal  and  ohemioal  (NBC)  reports. 

Although  the  software  for  those  automatic  functions  was  not  operational 
at  the  time  of  this  evaluation,  the  keys  and  their  functions  are  excellent 
examples  of  BMS's  potential  for  reduoing  the  users'  workload.  For  example, 
by  simply  selecting  "CALL  FIRE"  and  pointing  to  the  target's  looation  on  the 
digitized  terrain  data  base,  the  user  should  be  able  to  aoourately  request 
and  direct  artillery  fires  to  enemy  targets. 


Capabilities  and  Limitations  of  BMS  Interface 

The  prototype  provided  by  Lockheed  for  this  effort  served  as  a  researoh 
tool  for  elioltlng  user  interface  requirements  for  the  design  and  development 
of  the  BMS,  the  primary  produot  improvement  planned  for  the  M1A1  Block  II 
modifications.  This  section  summarizes  the  operational  capabilities  and 
limitations  inherent  in  the  interface  prototype  at  the  time  of  this  evalua¬ 
tion.  In  addition,  the  software  enhancements  anticipated  for  subsequent 
research  are  briefly  discussed. 

The  primary  operational  capabilities  of  the  prototype  allowed  users  to 
(1)  call-up  and  manipulate  a  digitized  terrain  data  base  and  (2)  oompose 
and  edit  taotioal  reports  independent  of  FM  voice  radio  transmissions.  The 
prototype's  map  manipulation  functions  previously  described  (e.g.,  feature 
selection,  free  draw,  pan,  zoom,  soroll)  provided  the  users  an  unprecedented 
and  powerful  technology  to  precisely  tailor  the  map  displays  to  meet  their 
immediate  areas  of  interest  and  course  of  action.  The  report  functions, 
utilizing  menu-structured  informational  elements  provided  users  a  unique 
opportunity  to  compose  and  edit  tactioal  reports  in  a  nonvooal  manner. 

A  more  fundamental  characteristic  of  the  prototype  is  that  it  provided 
users  the  opportunity  for  a  direct  hands-on  assessment  of  the  overall  layout 
and  integration  of  the  various  BMS  features  and  controls.  An  important  capa¬ 
bility  of  the  BMS  prototype,  therefore,  was  the  generation  of  the  base 
display  model  including  the  relative  size,  location  and  integration  of  the 
previously  described  subdisplays  and  functions.  This  capability  was  further 
enhanced  by  the  prototype's  ability  to  project  the  base  display  in  different 
sizes  (7-,  8-,  9-  or  18-  inches)  and  chromatic  levels. 
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The  design  of  the  BMS  Interface  is  an  extension  of  ARI's  research  pro¬ 
gram  in  automated  command  and  control  (C2)  systems.  In  particular  BMS  C2 
requirements  are  related  to  similar  requirements  being  identified  for  the 
Vehicle  Integrated  Intelligence  V(IN?)2  oonoept.  Interface  sequences  and 
display/control  requirements  were  recently  proposed  for  the  V(INT)2  interface 
(McCallum,  Harris  &  Fuller,  1985).  A  task-based  analysis  of  information 
requirements  for  tactical  maps  has  been  developed  and  the  resulting  map  in¬ 
formation  requirements  oould  be  used  in  future  BMS  researoh  to  generate  rep¬ 
resentative  map  development  guidelines  aoross  C2  systems  (Landee,  Samet  & 
Foley,  1979).  System  capabilities  required  for  generating  topographio  dis¬ 
plays  unique  to  the  Armor  environment  have  also  been  reoently  suggested 
(Rogers,  1983) •  Once  the  preliminary  BMS  interface  requirements  are  estab¬ 
lished,  subsequent  researoh  should  foous  on  incorporating  the  V(INT)2  infor¬ 
mational  requirements  and  development  guidelines  for  an  Integrated  C2  system 
aoross  echelons. 

Due  to  a  pressing  suspense  deadline  and  the  vagaries  of  IR&D  supported 
development,  not  all  of  the  display  and  oontrol  features  and  runotlons 
anticipated  were  operational  at  the  time  of  this  evaluation.  Capabilities 
anticipated,  but  not  operational  during  this  evaluation  inolude:  automated 
key  functions  (NBC,  CALL  FIRE,  and  CONTACT);  transmission  of  textual  reports 
and  graphic  overlays;  status  and  fire  support  functions;  preparation  and  se¬ 
lective  oall-up  of  oomplete  taotioal  overlays;  and  simulation  of  vehicle 
movement  and  combat  dynamios.  A  more  pervasive  limitation  of  the  ourrent 
prototype  was  the  Inability  to  automatically  oolleot  and  tabulate  users' 
inputs  and  reaction  times  in  relation  to  a  mission  oriented,  or  a  soenario- 
driven,  time  log.  This  restriction  prohibited  the  evaluation  of  objective 
measures  of  the  users'  speed  and  aoouracy  of  response  via  BMS,  relative  to 
conventional  or  baseline  performance  standards. 

Future  researoh  efforts  will  require  that  most  of  the  ourrent  prototype 
limitations  be  redressed.  In  addition,  many  of  the  lessons  learned  from  this 
effort  are  expected  to  be  implemented.  The  design  and  development  of  any 
battlefield  system  is  an  iterative  process  that  requires  continuous  refine¬ 
ment  and  modification.  The  results  of  this  effort,  to  be  presented  in  the 
following  sections,  have  provided  a  firm  basis  for  the  specification  of  some 
general  BMS  interface  requirements  and  clear  direction  about  a  number  of 
researoh  issues  that  should  be  addressed  more  thoroughly. 


RESEARCH  OBJECTIVES 


The  recent  literature  has  provided  numerous  guidelines  for  the  design 
and  development  of  user  friendly  interactive  computer  systems.  Human  Fac¬ 
tors  Review  (Muckier,  1984),  for  example,  includes  an  excellent  collection  of 
articles  that  provide  comprehensive  reviews  of  the  empirical  research  on 
human  factors  for  visual  display  terminals,  voice  technology,  dialogue  design 
and  computer  assisted  instruction.  In  addition  researchers  from  several 
military  agencies  have  recently  published  design  guidelines  more  directly 
related  to  the  battlefield  automated  systems  such  as  "Human  Engineering 
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Guidelines  for  Management  Information  Systems"  (Hendricks,  Kilduff,  Brooks, 
Marshak,  &  Doyle,  1983)  and  "Design  Guidelines  for  User  Transactions  with 
Battlefield  Automated  Systems:  Prototype  for  a  Handbook"  (Sidorsky,  Parrish, 
Gates,  &  Munger,  1984).  These  handbooks  and  reviews  provide  an  invaluable 
base  of  Information  for  designers  faced  with  a  myriad  of  design  decisions  as 
they  develop  a  unique  system.  In  general,  the  limitations  of  this  literature 
are  that  these  guidelines  are  frequently  the  result  of  researoL  on  isolated 
system  oomponents  rather  than  oomplex  systems,  and  the  findings  are  often 
based  on  task  requirements  and  criterion  measures  unrelated  to  the  system 
under  development. 

More  specifically,  the  application  of  these  guidelines  to  automated  sys- 
tern  design  is  more  of  an  art  than  a  soienoe.  The  guidelines  previously  dis¬ 
cussed  are  only  a  generic  set  of  reoommendatlons  and  oaveats  that  the 
designer  should  oonsult  for  preliminary  planning  and  alternative  design 
strategies.  The  designer  must  adapt  these  generalized  preoepta  to  the  spe¬ 
cific  set  of  tasks,  user  oharaoterlatios,  equipment  and  operational  environ¬ 
ment  in  question.  As  preliminary  mookups  of  the  initial  design  are  prepared 
the  designer  attempts  to  incorporate  any  relevant  guidelines  into  a  ooherent 
framework  of  operating  oharaoterlatios.  But  the  unique  features  and  interac¬ 
tive  requirements  of  the  ourrent  design  quickly  foroe  the  designer  to 
"extrapolate"  from  theoretical  principles  to  a  preolse  and  integrated  set  of 
innovative,  and  often  previously  unspecified,  system  oharaoterlatios. 

The  development  of  the  BMS  interface  designed  for  this  evaluation  fol¬ 
lowed  a  similar  pattern.  The  initial  design  oonoepts  were  based  on  many  of 
the  guidelines  previously  established  (e.g.,  oolor  and  shape  ooding,  menu- 
struotured  formats,  reverse-video  feedbaok,  and  standardized  display  lay¬ 
outs).  But  after  these  initial  design  strategies  were  adopted,  the  taotics  of 
implementation  Involved  a  series  of  judgments  and  compromises  for  integrating 
multiple,  and  at  times  oompeting,  design  guidelines  and  constraints. 

The  prototype  interface  was  designed,  therefore,  to  test  a  variety  of 
fundamental  Issues  with  regard  to  BMS  interfaoe  specifications  suoh  as  opti¬ 
mal  display  size  and  layout,  achromatio  vs.  chromatic  displays,  free  draw 
versus  select,  menu  structure  and  organization.  Working  within  the  general¬ 
ized  human  faotors  guidelines,  the  objectives  for  this  effort  were  to  (1) 
design  and  develop  a  prototype  Interfaoe  for  BMS  display  and  oontrol  func¬ 
tions,  (2)  provide  a  representative  oross-sample  of  small  unit  leaders  the 
opportunity  for  hands-on  testing  of  the  prototype  display  and  oontrol  func¬ 
tions,  (3)  identify  the  user  interfaoe  requirements  resulting  from  this  test, 
and  (4)  reoommend  future  design  specifications  for  development  of  the  BMS 
interface. 


vmpjmt-s 


METHOD 


Subjeota 

Twenty-nine  subjeota  were  saleoted  to  participate  in  this  evaluation. 
They  oame  from  three  primary  atudent  groups  at  Fort  Knox,  Kentuoky:  12  from 
the  Armor  Officer  Advanoed  Courae  (AOAC)  for  company  oommandera;  11  from  the 
Advanoed  Nonoommisaioned  Officer  Courae  (ANCOC)  for  platoon  and  first  ser¬ 
geants,  and  6  from  the  Basio  Nonoommisaioned  Offioer  Courae  (BNCOC)  for  tank 
oommandera.  These  soldiers  were  selected  aa  a  representative  oroaa-section 
of  small  unit  leaders  and  aa  a  basis  for  making  comparisons  about  differences 
in  user  requirements  as  a  funotion  of  differences  in  training  and  operational 
background . 


Equipment 

The  overall  design  and  description  of  the  interface  prototype  used  for 
this  evaluation  was  provided  in  a  previous  seotion.  The  integrated  raster 
Imaging  system  of  the  1400  IRIS  provided  a  powerful  computing  system  for 
manipulating  or  reconfiguring  both  2  dimensional  and  3  dimensional  prototype 
displays  and  oontrols.  The  system's  high  resolution  monitor  provided  the 
oapabillty  to  test  a  variety  of  map  soales  and  display  sizes.  All  software 
programs  were  written  in  C  and  UNIX. 


Procedure 


To  ensure  that  user  requirements  were  based  on  actual  hands-on  assessment 
of  the  BMS,  all  soldiers  were  run  in  individual  sessions  and  all  recommenda¬ 
tions  and  specifications  were  obtained  as  the  user  interacted  directly  with 
the  features  and  functions  in  question.  Prior  to  these  individual  sessions, 
initial  briefings  were  held  for  each  of  the  three  olasses  at  the  experimental 
site.  During  these  briefings  eaoh  group  was  Informed  that  the  general  pur¬ 
pose  of  their  participation  was  to  provide  user  requirements  for  BMS  and  then 
they  were  given  a  demonstration  of  the  prototype’s  primary  features  and 
funotlona.  These  briefings  were  oonduoted  to  both  reduce  the  time  needed  to 
familiarize  soldiers  with  the  system,  and  also  to  stimulate  their  thinking 
about  potential  BMS  design  and  development  requirements. 

During  their  individual  sessions  eaoh  participant  was  plaoed  in  the  role 
of  "user"  by  providing  him  oomplete  oontrol  over  the  BMS  input  devioes,  a 
mouse  and  traokball,  and  requiring  him  to  construct  his  own  map  and  report 
displays.  To  ensure  that  all  participants  contributed  responses  to  the  ques¬ 
tionnaire  items  their  interactions  with  the  BMS  were  structured  in  the  same 
order  and  sequenoe:  map,  reports,  keys,  messages,  time,  input  devices,  and 
radio. 

Eaoh  soldier  therefore  began  his  session  (two  hours)  with  a  thorough 
consideration  of  the  map  display  and  the  digitized  terrain  data  base  as  de¬ 
picted  by  the  prototype.  The  user  constructed  multiple  sets  of  natural  and 
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man-made  features;  manipulated  the  map  region  via  the  zoom,  soroll  and  oentor 
functions;  and  annotated  the  map  with  both  free  draw  and  graphic  select  func¬ 
tions.  As  he  viewed  eaoh  of  these  features  and  funotlons  he  was  dlreoted  to 
oomplete  related  Items  on  the  questionnaire.  Eaoh  participant  then  prooeeded 
to  the  next  funotlonal  area,  reports,  where  he  composed  a  variety  of  menu- 
driven  report  messages  suoh  as  SPOT,  SHELL,  NBC  -1  and  -4.  After  answering 
the  set  of  questionnaire  items  about  these  report  funotlons,  he  prooeeded 
in  a  similar  manner  through  eaoh  of  the  remaining  prototype  features  and 
funotlons  and  their  reapeotlve  questionnaire  items. 


Materials  and  Measures 


The  instruments  used  to  obtain  user  interfaoe  requirements  for  this 
evaluation  were  (1)  a  structured  questionnaire  and  (2)  a  protoool  reoord. 
The  questionnaire  was  used  to  ensure  that  users'  responses  were  oolleoted  for 
a  uniform  set  of  design  issues,  and  the  protoool  reoord  served  as  a  baokup 
measure  for  oapturing  any  users'  oomments  and  recommendations  not  lnoluded  in 
the  formal  questionnaire. 

The  questionnaire  lnoluded  63  items  that  were  olustered  around  the  fol¬ 
lowing  BMS  features  and  funotlons:  digitized  map  and  terrain  features;  re¬ 
port  composition  and  editing;  dedioated  and  variable  funotlon  keys;  inooming 
messages  and  alerts;  input  deviaea;  radio  controls  and  displays;  and  degraded 
blaok  and  white  displays.  Both  the  olusters  and  the  Items  within  eaoh  dus¬ 
ter  were  presented  in  the  same  sequenoe  for  all  respondents  and  this  corre¬ 
sponded  to  the  order  in  whloh  respondents  used  and  then  evaluated  the 
prototype  features  and  controls  (of.  procedures).  Questionnaire  items  were 
predominantly  close-ended— rank  order,  dlohotomous,  3  pt.  Likert— to  provide 
a  basis  for  quantifioation  and  oomparison.  In  addition  to  the  questionnaire 
addressing  BMS  features  ar.d  funotlons,  a  brief  biographioal  or  background 
questionnaire  was  lnoluded  to  identify  any  differences  in  user  requirements 
as  a  funotlon  of  military  baokground  and  training.  A  oomplete  oopy  of  the 
structured  questionnaire  is  lnoluded  in  Appendix  A  for  the  reader's  inspec¬ 
tion. 


The  protoool  reoord  of  users'  verbal  responses  was  maintained  for  both 
the  open-ended  items  lnoluded  in  the  original  questionnaire  and  to  reoord  any 
additional  Insights  or  reoommendations  provided  by  the  respondents  that  were 
not  anticipated  during  oonstruotion  and  design  of  the  formal  questionnaire. 
Users'  responses  were  transcribed  by  the  experimenters  during  eaoh  session 
and  a  oontent  analyses  of  these  responses  is  provided  in  Appendix  B. 

It  should  be  noted  that  all  findings  reported  are  based  on  the  subjeo- 
tive  evaluation  by  the  users  rather  than  derived  on  the  basis  of  objective 
performance  measures.  But  as  previously  described,  the  prooedures  were  de¬ 
signed  to  ensure  that  users'  evaluations  were  based  on  their  Immediate  and 
hands-on  experience  with  the  BMS. 
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RESULTS  AND  DISCUSSION 


The  general  findings  for  eaoh  of  t,hs  major  BMS  lnterfaoe  features  and 
funotions  tested  during  this  evaluation  are  presented  below.  These  results 
are  based  on  responses  to  the  questionnaire  and  where  appropriate  supple¬ 
mented  by  additional  reoommendations  obtained  from  the  protoool  reoord*  The 
reader  is  referred  to  Appendix  A  where  the  data  for  eaoh  Item,  summarized  by 
olass  and  aoross  the  entire  sample ,  are  appended  to  a  oopy  of  the  original 
questionnaire.  This  appendix  ensures  a  comprehensive  reoord  of  all  detailed 
results  and  at  the  same  time  provides  the  reader  a  more  aoourate  oontext  for 
interpreting  the  findings  to  be  reported.  Referenoes  to  Appendix  A  for  the 
speoifio  findings  reported  below  are  enolosed  in  braokets  (i.e.,  [A-1,1] 
Appendix  A,  page  1,  item  1). 

In  addition,  Appendix  B  provides  a  nearly  verbatim  transcript  of  users' 
supporting  oomments  and  recommendations,  the  protoool  reoord.  The  oontent 
analyses  of  this  protoool  reoord  also  inolude  the  frequenoy  and  souroe  for 
these  statements  to  provide  designers  an  index  of  the  users'  support  for  eaoh 
modification  requested,  and  the  different  requirements  anticipated  for  vari¬ 
ous  types  of  users.  Results  from  Appendix  B  frequently  summarize  aoross  a 
number  of  respondents'  oomments,  referenoes  to  this  protoool  reoord  indi¬ 
cate  the  page(s)  on  whioh  these  oomments  may  be  found  (i.e.,  [B-2  to  B-4] 
Appendix  B,  pages  2  to  4). 


Map  Features  and  Funotions 


The  BMS  interface  prototype  developed  for  this  evaluation  afforded  users 
the  relatively  unique  opportunity  to  explore  the  capabilities  and  limitations 
of  a  digitized  terrain  data  base  In  the  oontext  of  Armor  operations.  The 
transition  from  oonventlonal  paper  maps  to  the  eleotronio  map  formats  tested 
during  this  evaluation  marks  a  significant  ohange  in  the  standard  operating 
procedures  of  all  military  personnel.  Users  were  instructed  to  oonsider  the 
eleotronio  maps  as  a  supplement  to  paper  maps  and  not  as  a  replaoement. 


Comparability.  A  primary  oonoern  about  the  utility  of  the  prototype's 
eleotronio  map  display  was  its  comparability  to  the  oonventlonal  medium  of 
paper  maps.  To  provide  an  index  of  comparability,  users  were  requested  to 
rank  order  ten  (10)  primary  natural  and  man-made  topographio  features  as 
portrayed  by  eaoh  medium  with  respeot  to  their  importanoe  for  Armor  opera¬ 
tions  [A-1,1].  The  transition  to  digitized  terrain  and  eleotronio  map  dis¬ 
plays  resulted  in  no  significant  changes  in  the  users'  prioritization  of 
these  terrain  features  [A-1,2],  The  five  most  important  features  seleoted  by 
all  users  for  both  conventional  and  eleotronio  maps  were:  contour  lines, 
roads,  vegetation,  water  and  towns.  The  reliability  of  these  ratings  is 
further  evidenced  by  the  faot  that  the  ordering  for  the  three  most  important 
features  (i.e.,  oontour  lines,  roads  and  vegetation)  were  invariant  for  both 
mediums  aoross  eaoh  of  the  three  subgroups  of  users  tested— AOAC,  ANCOC  and 
BNCOC. 
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The  rank  order  of  the  remaining  topographio  features— borders,  names  of 
towns  and  roads,  ohurohes,  towers  and  power  lines — were  relatively  the  same 
for  both  conventional  and  electronic  maps.  The  only  noteworthy  exception 
might  be  that  while  power  lines  were  rated  tenth  or  least  important  on  con¬ 
ventional  maps,  they  were  rated  seventh  on  electronic  map  displays.  The 
relatively  higher  importance  attributed  to  power  lines  on  the  prototype  map 
displays  may  have  been  oaused  by  the  visual  prominenoe  or  salienoe  of  this 
feature  relative  to  the  other  terrain  features  deploted.  The  present  data 
oan  not  resolve  this  question,  and  the  prototype  as  tested  oould  r.ot 
systematically  vary  the  prominenoe  of  seleoted  features.  The  potential  ef- 
feot  of  visual  prominenoe  for  intentionally  aooenting  or  unintentionally 
exaggerating  terrain  features  or  military  units  and  symbols  is  taken  up  in 
the  final  seotion. 

While  the  overall  rank  orderings  provide  only  a  rough  index  of  the 
comparability  between  between  conventional  and  eleotronlo  may  maps.  They  do 
suggest  that  the  transition  to  eleotronlo  map  displays  may  not  signifioantly 
distort  the  users'  prioritization  and  utilization  of  map  information. 

The  protoool  reoord,  also,  stresses  the  need  to  provide  a  BMS  map  format 
that  is  as  comparable  as  possible  to  that  of  the  conventional  military  map. 
The  eleotronlo  map  tested  used  a  blaok  background  with  a  small  palette  of 
feature  oolors.  These  colors  were  seleoted  to  enhanoe  feature  dlsorimln- 
ability  rather  than  comparability  with  oolors  used  in  conventional  map  pro¬ 
duction.  Participants  strongly  reoommended  that  if  BMS  displays  utilize 
oolor,  the  feature  portrayal  and  ooloration  should  correspond  to  conventional 
formats  [B-2  to  B-4].  This  point  is  well  taken  not  only  with  respeot  to 
issues  of  transfer  from  one  medium  to  the  other;  but  also  with  a  basio  prem¬ 
ise  of  BMS  that  it  is  Intended  to  supplement  conventional  map  skills  and 
exerolses,  not  supplant  them. 


Feature  Seleotion/Deletion.  One  of  the  primary  advantages  provided  by  a 
digitized  data  based  over  conventional  maps  is  that  the  former  oan  be  repeat¬ 
edly  "tailored''  to  the  needs  of  different  users  as  well  as  to  the  immediate 
task  requirements  that  eaoh  user  is  currently  executing.  The  user  oan  selec¬ 
tively  oall-up  any  particular  combination  of  map  features  and/or  operational 
overlays  relevant  to  his  immediate  oourse  of  action.  Users  were  unanimous  in 
requesting  that  future  BMS  systems  provide  this  selective  oall-up  and  delete 
capability  [A-2,  5-6]. 

In  addition  respondents  were  asked  what  subset,  of  the  ten  features 
available,  should  be  automatically  called-up  by  BMS  when  users  first  initi¬ 
alize  or  bring  up  the  map  display,  to  reduoe  entry  requests  by  users.  Only  5 
of  the  10  terrain  features  available  were  requested  by  a  majority  of  all 
participants  [A-2,  7].  Those  features  seleoted  were  contour  lines,  roads, 
vegetation,  water,  and  towns;  the  same  features  rated  as  most  important  pre¬ 
viously.  This  result  not  only  indicates  the  reliability  of  ratings  provided 
by  these  users,  but  more  importantly  the  realistio  constraints  imposed  on  the 
interpretation  of  relatively  oompressed  map  display  area.  The  map  display 
area  was  allotted  less  than  60%  of  the  total  BMS  base  display  area.  To  en¬ 
sure  map  interpretability,  given  the  relatively  small  areas  projected  and 
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tested  for  BMS  base  displays  (7-  to  9-  inches  diagonally) ,  the  requirement 
for  the  capability  to  selectively  oall-up  or  delete  map  data  is  further  rein¬ 
forced.  It  should  be  kept  in  mind  that  this  subset  of  features  was  requested 
in  the  context  of  general  Armor  operations,  rather  than  any  speoifio  mission 
phase  or  segment. 


Map  Soale  and  Movement.  The  need  for  a  mors  adaptable  map  format  on  BMS 
is  further  aooented  by  the  users'  unanimous  recommendations  for  eaoh  of  the 
map  oontrol/movement  functions  provided  by  the  prototype:  the  ability  to 
zoom  in  or  out  with  reapeot  to  the  users'  Immediate  area  of  interest  (map 
ranges  tested  were  from  30  x  30  km  down  to  3  x  3  km  regions)  tA-4,12];  the 
ability  to  move  any  designated  map  area  to  the  oenter  of  the  map  display 
window  [A-4,14];  and  the  ability  to  move  the  map  up  or  down,  left  or  right 
[A-4,13]. 

The  protoool  reoord,  however,  strongly  suggests  that  any  continuous  zoom 
feature  be  ooupled  with  a  users'  set  of  disorete  zoom  levels  that  automatic¬ 
ally  resolve  to  lower  eohelon  areas  of  interest  (i.e.,  30  x  30  km  for  oompany 
oommanders  [B-3,  B-4],  6  x  6  km  for  platoon  leaders,  and  3  x  3  km  for.  indi¬ 
vidual  tank  oommanders).  Questionnaire  items  assessing  the  users  preferred 
map  aoales  indioate  that  for  the  levels  Investigated  (i.e.,  oompany  oom- 
mander,  platoon  leader,  first  sergeant,  platoon  sergeant  and  tank  oommander) 
a  1:50,000  la  the  most  preferred,  and  a  1:25,000  is  their  seoond  oholoe 
C A— 3, 11].  This  preference  for  1:25,000  over  1:125,000  suggests  that  even  at 
the  oompany  level,  small  unit  oommanders  are  generally  willing  to  sacrifice 
topographical  range  for  greater  detail  on  their  BMS  map  displays. 

It  should  be  noted  that  a  position  looatlon  or  positive  navigational 
system  was  not  available  on  this  BMS  prototype.  Additional  researoii  should 
be  aonduoted  to  determine  users'  recommendations  and  speolfloatlons  regarding 
this  feature  (e.g.,  "In  what  area  of  the  map  display  should  your  vehiole  be 
looated?").  In  addition,  the  protoool  reoorda  suggest  the  need  for  a  closer 
look  at  the  problems  of  disorientation  that  might  arise  as  a  result  of 
system-lnduoed  map  and  symbol  movements  [B-5,  B-6], 


Draw  or  Seleot.  A  series  of  questionnaire  items  were  direoted  at  BMS 
functions  related  to  the  graphic  generation  and  representation  of  battlefield 
information  suoh  as  operational  overlays.  Users  were  first  allowed  to 
annotate  their  maps  with  both  a  free  draw  funotion  (using  the  mouse  and 
trackball)  and  a  vehiole  or  oontrol  measure,  select  funotion.  They  were 
subsequently  asked  whether  eaoh  of  the  taotical  overlays — operational, 
threat,  fire  support  and  obstacles — should  be  generated  by  either  a  free  draw 
or  seleot  function  [A-3,8].  While  BNC0C  students  appear  significantly  more 
inolined  than  AOAC  and  ANCOC  respondents  to  seleot  rather  than  draw  these 
graphics;  the  overall  reoord  reveals  a  very  mixed  pattern  of  results  aoross 
all  three  classes.  A  mitigating  factor  is  that  users'  preference  for  free 
draw  may  have  been  lowered  because  they  were  forced  to  draw  using  a  mouse  and 
trackball  rather  than  with  a  llghtpen  or  on  a  touoh  sensitive  screen,  and 
this  issue  should  be  further  investigated.  Nevertheless,  the  results  suggest 
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that  in  view  of  the  wide  range  of  both  potential  users  and  types  of  graphic 
overlays  required,  BMS  should  inolude  both  draw  r.nd  select  functions  for  the 
production  of  graphio  data. 


Pioture  or  Symbols.  A  oentral  issue  In  this  area  of  graphic  representa¬ 
tion  Is  how  best  to  generate  a  standardized  set  of  taotloa).  features  for  con¬ 
structing  operational  overlays.  These  features  oust  distinguish  between 
various  types  of  vehloles  and  weapon  systems  for  both  friendly  and  enemy 
foroea  as  well  as  an  extensive  set  of  military  oontrol  measures  suoh  as  oheok 
points,  obstacles,  target  reference  points,  phase  lines.  The  military  has 
developed  a  formal  set  of  symbologies  for  all  standard  tactical  features 
(Field  Manual  21-30)  and  over  70$  of  all  users  requested  that  system-gener¬ 
ated  graphios  allow  users  to  seleot  these  symbols  rather  than  piotorlal  im¬ 
ages  [A-3,93.  The  effloienoy  of  the  symbollos  is  apparent  especially  in  the 
representation  of  multi-vehiole  foroea  (e.g.,  platoon,  company,  battalion). 
But  military  unit  symbols  have  been  found  to  have  low  or  negative  transfer  of 
training,  high  potential  for  confusion  and  low  association  value  (Jarosz  A 
Rogers,  1982).  In  addition,  symbols  must  be  learned  and  require  a  higher 
order  of  prooesslng  than  the  more  Intuitive  representations  of  piotorlal 
images.  Battlefield  oondltlons  suoh  as  the  turbulence  due  to  attrition  and 
the  stress  associated  with  combat  may  seriously  impair  the  soldier's  under¬ 
standing  of  taotlcal  overlays  that  rely  entirely  on  symbolio  features.  In 
addition  it  should  be  noted  that  many  of  the  users  tested  (29$)  requested 
piotorlal  images  over  military  symbology  [A-3,9l» 

Qlven  the  relatively  minor  system  memory  requirements  involved,  it  is 
reeommended  that  redundant  oodlng  systems  be  included  in  BMS  to  override 
degrading  battlefield  conditions  that  may  impair  soldiers'  memory  and  compre¬ 
hension.  All  tactloal  features  should  be  ooded  symbolically,  piotorlally  and 
textually.  The  user  would  have  the  option  of  representing  tactical  features 
on  his  own  BMS  in  either  a  symbolio  or  piotorlal  mode,  although  all  trans¬ 
missions  between  users  would  revert  to  a  uniform  digital  oode.  Additionally 
by  providing  a  textual  label  and  definition  to  the  user,  especially  the  new 
user  in  cases  of  attrition,  he  oould  quiokly  review  the  name  and  key  informa¬ 
tion  about  the  feature  In  question  (e.g.,  the  personnel  and  weapon  system 
characteristics  of  a  motorized  rifle  battalion). 


Additional  Map  Issues.  A  primary  assumption  in  the  design  of  the  BMS 
prototype  tested  was  that  the  map  displays  should  be  assigned  to  a  dedicated 
or  permanent  window  on  the  BMS  display.  Protocol  reoords  strongly  suggest, 
however,  that  a  continuous  map  display  is  neither  required  or  preferred 
[B-7].  Users  wore  quite  willing,  to  trade-off  the  previously  dedicated  map 
area  for  enlargement  of  the  reporting  window  during  periods  of  reduced  activ¬ 
ity  (e.g.,  assembly  area,  consolidation). 

Finally,  the  protocol  reoord  strongly  suggests  that  a  number  of  nap 
functions  not  available  on  this  prototype  be  included  in  the  BMS  display  fea¬ 
tures:  oblique  or  three  dimensional  views  of  surface  configurations;  line  of 
sight;  and  graded  elevation  shading  (B-2  to  B-6]. 
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Report  Features  and  Funotlona 


A  reality  of  human  communication  is  that  speaking  is  a  more  fluent  and 
informative  modality  than  writing.  BMS  faoes  a  serious  challenge  In  its  goal 
of  bypassing  the  conventional  voioe  mode  of  oommunioation— the  FM  radio. 

Aware  of  this  limitation,  this  reaearoh  paid  considerable  attention  to  the 
issue  of  oommunioating  and  reporting  via  BMS. 

It  should  be  noted  that  the  findings  reported  in  this  seotlon  are  pri¬ 
marily  restricted  to  the  menu  formats  designed  for  this  BMS  prototype.  While 
arguments  for  a  keyboard  transcription  of  all  reports  or  preformatted 
form-filling  alternatives  to  auoh  menus  might  be  considered,  the  time  re¬ 
quired  for  the  user  to  generate  eaoh  alphanumeric  oharaoter  must  not  be  un¬ 
derestimated.  In  view  of  the  need  for  more  rapid,  aoourate  and  automated 
report  functions  the  BMS  prototype  tested  was  designed  around  menu  formats 
from  whioh  users  only  seleoted,  rather  than  generated,  their  report  elements. 


Menu  Structure.  Working  within  the  oonfines  of  a  dedioated  report  win¬ 
dow  (the  variable  menu  display  (e)  depleted  in  Figures  1  and  2)  rather  than 
the  entire  BMS  display  area,  this  menu  structure  generally  required  users  to 
(1)  review  and  select  from  7  to  10  “pages"  of  information  to  be  included  in 
their  reports  and  (2)  provide  1*i  to  20  key  entries  to  oomplete  a  single  re¬ 
port  (e.g.,  SPOT,  SITREP,  NBC).  It  should  be  noted  that  all  dootrinally  pre¬ 
scribed  elements  within  eaoh  report  were  inoluded  (e.g.,  orater  width,  type 
of  agent,  duration  of  the  attaok  eto.)  for  this  evaluation  whioh  in  part  con¬ 
tributed  to  their  length.  To  overoome  the  complexity  of  this  reporting  func¬ 
tion,  a  number  of  potential  design  modifications  were  investigated. 

Before  disoussing  these  modifications,  it  is  noted  that  79%  of  all  users 
described  the  menu  structures  designed  and  tested  for  this  evaluation  as 
"easy"  or  "very  easy"  to  use  [A-6,24]  and  89K  reported  that  this  extended  set 
of  report  elements  ensured  that  their  final  reports  wore  oomplete  and  accu¬ 
rate  messages  (A-5,  173.  Users’  description  of  the  menu-struotured  reports 
as  "easy"  indioates  that  they  had  surprisingly  little  difficultly  understand¬ 
ing  how  to  seleot  the  appropriate  information  (e.g.,  tank,  aircraft,  person¬ 
nel)  or  how  to  step  through  the  various  pages  from  whioh  they  seleoted  all 
the  information  required  tor  their  report.  This  is  further  reinforced  by  the 
faot  that  79%  of  all  users  found  that  the  editing  functions  for  oorreoting 
and  updating  their  reports  were  acceptable  [A~|5,2?J.  Users  were  able  to  edit 
their  reports  on  eaoh  page  as  they  proceeded  through  tha  informational  ele¬ 
ments,  or  at  the  end  of  their  report  on  the  summary  page.  From  this  summary 
page  that  listed  all  the  Information  the  user  had  seleoted,  the  user  could 
seleot  any  element  and  return  directly  to  the  original  page  to  adit  his  re¬ 
port  (e.g.,  change  in  speed,  number  of  vehicles  observed  etc.)..  This  infor¬ 
mation  was  immediately  updated  on  the  summary  page  for  a  final  inspection 
before  "transmission". 

Menu  Modifications,  Although  the  menu  structure  for  report  composition 
and  editing  appears  to  be  a  promising  modal  for  the  BMS  design,  considerable 
attention  must  be  directed  at  modifications  to  reduce  the  number  of  pages  and 


15 


key  entries  required  for  this  function.  It  should  be  reoalled  that  during 
this  evaluation  standardized  display  areas  were  maintained  and  the  map  area 
was  retained  at  all  times  for  continuous  terrain  and  situation  displays.  As 
indicated  previously,  users  dearly  indioated  that  during  periods  of  reduoed 
aotivity  or  "lulls  in  the  battle"  they  did  not  feel  the  map  was  required  and 
therefore,  at  such  times,  most  of  the  BMS  display  oould  be  used  for  report 
functions  [B— 7  3 •  This  expanded  display  region  would  oertainly  reduoe  the 
number  of  pages  required  for  reporting;  and  if  ooupled  with  a  lightpen  or 
touoh- interactive  screen,  discussed  later,  the  users'  entries  required  for 
information  selection  could  be  made  more  easily. 

Other  modifications  for  streamlining  report  requirements  might  be  to  re¬ 
duce  either  the  number  of  reports  inoluded  in  the  BMS  software  or  to  reduoe 
the  number  of  informational  elements  required  to  complete  eaoh  report.  Both 
alternatives  were  addressed  by  the  questionnaire  and  a  review  of  the  results 
will  provide  BMS  designers  the  users'  preliminary  guidelines  oonoerning  the 
frequency  of  ooourrenoe  for  various  reports  [A-4,15]  and  the  relative  impor¬ 
tance  of  the  informational  elements  dootrinally  prescribed  for  oertain  re¬ 
ports  (e.g.,  SPOT)  [A-7,28].  In  addition,  the  protoool  records  stress  the 
need  for  a  oommon  format  aoross  all  reports  suoh  as  "who" ,  "what" ,  "where" , 
and  "when"  or  the  SALUTE  (size,  aotivity,  looation,  unit  and  time)  format 
[B— 6  to  B-8].  Implementation  of  any  alternatives  listed  in  this  paragraph, 
however,  may  require  doctrinal  changes  that  must  be  formally  sanctioned. 

Protocol  records  also  stress  the  need  for  additional  BMS  specifications 
related  to  the  report  funotion.  For  example,  users  require  system-generated 
wiring  diagrams  that  clearly  depiot  the  structure  of  the  hierarchical  menus 
used  for  both  reporting  and  other  funotiona  provided  by  BMS,  and  a  cursor 
control  dialog  that  automatically  shifts  the  oursor  to  the  next  most  probable 
data  entry  [B-6  to  B-8].  This  automated  oursor  "homing"  funotion  would  re¬ 
duoe  the  time  needed  to  complete  reports  and  is  consistent  with  questionnaire 
results  where  users  recommended  that  the  organization  of  menus,  and  informa¬ 
tional  elements  within  menus,  be  structured  "by  frequency  of  use"  [A-7,30]. 

A  similar  wiring  diagram  oould  be  provided  by  BMS  to  display  the  routing 
patterns  of  both  incoming  and  outgoing  messages  and  reports.  This  diagram, 
for  example,  might  Illustrate  how  an  operations  order  was  automatically 
partitioned  to  the  requirements  of  lower  echelons  and  precisely  what  informa¬ 
tion  was  disseminated  and  to  which  levels  of  command. 


Additional  Detail.  When  designers  attempt  to  preprogram  the  informa¬ 
tional  elements  required  for  tactical  reports  into  the  BMS  soft  are,  to  re¬ 
duoe  user-generated  alphanumeric  entries,  inevitably  not  all  contingencies 
will  be  foreseen.  The  structured  interview  directly  addressed  this  need  for 
"additional  detail"  to  be  added  to  the  reports  and  the  respondents'  recommen¬ 
dations  as  to  hew  this  detail  should  be  entered  by  the  user  into  BMS.  In 
general,  users  suggested  that  for  their  most  frequently  issued  reports--SPOT 
and  SIT11EP- -additional  detail  may  "often"  or  at  least  "sometimes"  be  required 
[A-5,18],  For  the  less  frequent  reports  such  as  NBC  1,  4  and  SHELL  they  re¬ 
ported  less  of  a  need  for  additional  detail,  but  few  were  willing  to  rule  out 
this  possibility. 
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Potential  solutions  assessed  by  the  questionnaire  for  entering  this  ad¬ 
ditional  detail  were  a  complete  typewriter  keyboard  with  all  alphanumeric 
oharaoters  and  a  smaller  (single  hand}  key  pad.  While  officers  from  AOAC 
were  evenly  split  (50$  Yes,  50$  No)  about  introducing  a  full  keyboard  onto 
the  tank,  nearly  75$  of  the  students  from  ANCOC  responded  "No"  [A-5,21].  The 
keypad  received  a  muoh  higher  endorsement  from  moet  users  [A-5,20],  but  there 
are  reservations  about  this  data.  The  keypad  question  did  not  speoify  what 
keys  might  be  inoluded  on  the  keypad  or  their  arrangement.  Respondents  faoed 
with  the  dilemma  of  additional  detail  to  be  reported,  yet  not  wonting  a 
"typewriter"  on  the  tank,  may  have  opted  for  the  unspecified  keypad.  In 
summary,  while  the  need  for  an  additional  detail  funotion  is  indicated,  the 
results  are  inoonoluaive  as  to  a  viable  BMS  speoifioatlon. 


Integrated  Functions 

One  major  conclusion,  anticipated  in  the  prototype's  design,  and  con¬ 
firmed  by  the  protocol  records,  is  that  BMS  must  Integrate  the  map  and  report 
functions  [B-6  to  B-8],  Nearly  all  military  communications  are  based  on  the 
spatial  geometry  of  the  battlefield.  The  real  potential  for  BMS  as  a  oommand 
and  oontrol  system  is  to  link  spatial  and  verbal  information,  to  synthesize 
map/graphio  data  with  verbal/reports  and  orders.  This  synthesis  is  not  only 
oritloal  to  meet  BMS  expectations  as  a  foroe  multiplier,  it  is  also  essential 
to  providing  commanders  a  BMS  that  minimizes  the  users'  requirements.  Two 
examples  will  be  briefly  disoussed  to  illustrate  this  potential. 

The  first  example,  is  the  apeolfioation  of  three  automatic  functions 
—CALL  FIRE,  NBC,  and  CONTACT— originally  designed  for  this  prototype,  but 
not  fully  operational  at  the  time  of  this  evaluation.  All  three  of  these  keys 
operate  on  the  assumption  that  spatial  and  verbal  reports  will  be  integrated 
by  BMS.  To  oall  for  indirect  artillery  fire,  for  example,  the  user  might  1) 
first  press  or  enable  the  "CALL  FIRE"  key,  2)  point,  or  move  the  oursor,  to 
the  map  area  of  enemy  aotivity,  and  3)  then  press  a  "SEND"  key.  A  request 
for  suppression  by  indireot  fire  is  then  immediately  sent  to  the  appropriate 
receiver  (fire  support  team,  artillery,  etc.).  Anyone  familiar  with  the 
relatively  complex  and  time  consuming  procedures  required  for  target  looation 
(e.g.,  polar  plot,  shift  from  a  know  point)  and  the  frequency  of  misdirected 
fires,  oan  readily  appreciate  how  important  the  integration  of  map  and  report 
functions  is  for  BMS, 

The  next  example  is  a  proposed  modification  designed  to  provide  users 
with  the  most  streamlined  report  function  acceptable.  By  integrating  spatial 
and  alphanumeric  data  into  the  same  report ,  SPOT  and  CITREP  reports  eould  be 
completed  on  one  "page"  of  the  BMS  display  using  the  "who",  "what",  "where", 
"how  many",  and  "when"  format.  "What"  and  "when"  should  be  data  automatic¬ 
ally  stamped  to  eaoh  BMS  report  when  the  report  concerns  a  current  aotivity. 
"Where"  would  be  indicated  by  touching  or  positioning  a  oursor  on  the  map 
display.  "What"  and  "how  many"  oould  be  entered  from  the  same  menu  page  if 
generic  descriptions  (e.g.,  heavy  or  light  track,  wheel,  fixed  or  rotary  air, 
and  troops)  were  listed  adjacent  to  a  numeric  keypad. 


17 


Response  Keys 


The  BMS  prototype  tested  did  not  include  a  separate  keyboard  or  keypad 
for  data  entry.  The  prototype  employed  "soft"  keys  on  the  base  display  to 
allow  for  software  rather  than  hardware  "fixes"  or  "retrofits"  to  BMS  units 
onoe  they  are  fielded.  All  keys  and  key  funotions  were  motivated  by  moving 
the  oursor  to  the  appropriately  labeled  key  area  via  the  traokball  and  acti¬ 
vating  or  "pressing"  the  key  by  pushing  the  mouse  button. 

In  general,  users  dearly  supported  the  requirement  that  BMS  displays 
inolude  the  array  of  main  funotion  (i.e.,  MAP,  REPORT,  RADIO,  STATUS,  and 
FIRE  SUPPORT)  and  automatio  funotion  keys  (i.e.,  CONTACT,  CALL  FIRE,  NBC) 
configured  on  the  prototype.  Ninety  peroent  of  all  users  requested  that 
these  keys  be  inoluded  in  a  dedioated  area  as  permanent  keys  on  the  BMS 
displays  [A-8,31].  In  addition  the  prototype’s  use  of  reverse-videoshading, 
to  indioate  that  a  key  had  been  seleoted  and  the  key  funotion  activated,  was 
requested  by  93)1  of  all  users  [A-8,32].  The  protoool  records  also  suggest 
the  need  for  additional  key  options  suoh  as  a  permanent  funotion  key  leading 
direotly  to  map  annotation  features,  rather  than  stepping  through  a  menu 
structure,  and  an  "ESCAPE"  key  or  other  feature  to  immediately  terminate  a 
ourrent  aotivity  in  favor  of  a  higher  priority  requirement  [B-8]. 

Given  the  restrioted  area  projeoted  for  BMS  displays  (7-  to  10-  inohes), 
the  legibility  of  key  labels  and  other  display  data  was  a  primary  oonoern  of 
this  investigation.  The  rapid  display  demonstrator  was  able  to  resoale  the 
entire  base  display  area  to  diagonal  dimensions  of  7-,  8-,  and  9-  Inohes  for 
users’  evaluation  and  18-  inohes  for  the  initial  olass  briefings.  For  ohar- 
aoter  sizes  and  resolution  levels  tested,  96*  of  all  users  reported  that  the 
9"  configurations  produoed  key  and  menu  labels  that  oould  be  easily  read. 

Over  75%  of  all  participants  were  willing  to  aooept  an  8"  display  size,  but 
more  thin  two  thirds  of  the  participants  reported  that  the  7"  display  was  too 
compressed  [A-8,31*].  Protoool  reoords  provide  a  number  of  recommendations 
for  further  enhanoing  legibility  such  as  abbreviated  key  labels  and  oolor 
ooded  keys  [B-8], 


Message  and  Alert  Features  and  Funotions 

The  BMS  prototype  did  not  have  a  fully  operational  software  program  for 
messages  and  alerts.  A  display  window  for  receiving  inooming  messages  (of. 
Figure  1 )  had  been  designed  and  incorporated  into  the  prototype  BMS  displays 
evaluated  by  our  sample  of  users.  In  addition,  mookups  of  various  alerts  and 
signals  were  developed  and  users  were  given  a  detailed  description  of  how  the 
message  and  alert  functions  might  operate  with  respeot  to  the  prototype's 
supporting  display  and  control  systems.  On  the  basis  of  this  orientation 
users'  reactions  were  solioited  to  provide  designers  at  least  some  prelimi¬ 
nary  guidelines  for  BMS  message  and  alert  functions. 

Users'  awareness  of  BMS’s  critical  role  in  enhancing  command  and  control 
is  reflected  in  their  unanimous  endorsement  of  the  need  for  a  permanent  win¬ 
dow  or  display  area  dedicated  solely  to  incoming  alerts  and  signals  [A-9,37], 
In  addition  9 T%  of  all  respondents  approved  of  the  location--upper  right  hand 
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corner  of  the  display  window— configured  for  this  evaluation  [A-9,38],  It  is 
expected  that  BMS  may  prioritize  incoming  messages  and  alerts  by  importance, 
93%  of  the  respondents  specified  they  must  be  able  to  override  this  automated 
funotion  [A-9,39].  In  addition,  86%  of  all  users  reoommended  that  inooming 
verbal  or  map/graphic  communications  not  be  entered  onto  their  displays  until 
they  pressed  a  "RECEIVE"  key  [A-9,42].  Similarly,  the  majority  of  all  users 
realized  that  "reception"  of  a  message  is  not  the  same  as  acknowledgement. 
BMS,  therefore,  should  not  lnolude  an  automated  acknowledgement  funotion,  but 
require  a  manual  acknowledgement  to  ensure  users'  reoeptlon  of  the  message. 
CA-9,41]. 

Users  strongly  endorsed  the  need  for  flashing  or  blinking  visual  alert 
and  message  signals,  and  86%  requested  that  they  be  ooupled  with  a  redundant 
auditory  signal  suoh  as  a  beep  or  buzzer  sound  [A-9»42].  To  ensure  that  the 
auditory  signal  was  heard,  many  of  the  respondents'  protocol  statements  urged 
that  this  signal  be  sent  over  the  FM  radio  or  transmitted  to  the  user  via  the 
CVC  headset.  In  addition,  users  reoommended  that  the  visual  signals  be  ooded 
(e.g.,  flashing  red  for  most  oritioal  signal)  to  indicate  its  relative  impor¬ 
tance  [B-9]. 


Date  and  Time  Features  and  Functions 


The  BMS  prototype  inoluded  a  date,  time  window  at  the  uppermost  right 
hand  corner  of  the  display  (of.  Figure  1)  and  continuously  provided  this 
information  in  a  digital  format  with  the  day  of  the  month  preceding  the 
hours/minutes/seoonds  in  the  following  manner:  11  1 400:59.  Users  unani¬ 
mously  endorsed  this  location  [A-10,48]  and  97%  approved  of  the  format 
[A- 10, 45].  Ninety  three  peroent  of  all  users  felt  this  information  was  im¬ 
portant  enough  to  warrant  continuous  display  and  a  permanent  window 
[A-10,47]. 

This  evaluation  also  attempted  to  identify  users'  needs  for  additional 
BMS  time  functions.  For  example,  89%  of  the  respondents  requested  that  the 
ti  e  format  be  annotated  with  Alpha  and/or  Zula  indicators  [A— 10, 46];  and  79% 
stated  that  an  H  hour  calculation  (e.g.,  H  -90  minutes,  H  +24  minutes)  would 
be  a  useful  function  for  monitoring  their  progress  in  terms  of  backward  plan¬ 
ning  and  rate  of  execution  [A-10,49].  The  protocol  record  also  includes  a 
number  of  requests  by  users  for  an  alarm  funotion  for  such  things  as  timing 
their  operations  and  sleeping  [B-9]. 


Input  Devices 

As  previously  indicated,  the  BMS  prototype  tested  used  a  mouse  and 
trackball  control  unit  for  all  user  inputs  and  interactions.  Users'  reserva¬ 
tions  about  these  input  devices  are  clearly  indexed  in  the  results  aeotion 
under  a  series  of  items  assessing  their  suitability  for  various  functions 
(i.e.,  selecting  menus,  drawing,  locating  objects  on  the  map)  [A-11,52], 

Their  most  serious  criticism  of  the  mouse  and  trackball  was  directed  at  draw 
functions,  and  72%  of  all  users  felt  that  these  controls  (as  tested)  were 
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inadequate.  Users'  prioritization  of  alternate  Input  systems  indicate  their 
preference  for  more  natural  or  intuitive  controls  such  as  a  touch-sensitive 
screen  or  lightpen. 

This  report's  results  should  be  regarded  as  tentative  with  respect  to 
users'  speoifioations  for  input  devioea.  A  limitation  of  this  evaluation  la 
that  the  preferred  input  systems  were  not  provided  for  hands-on  tests.  In 
addition,  the  laboratory  setting  does  not  approximate  the  vehiole  turbuleuoe 
associated  with  oross  oountry,  high  speed  maneuvers  where  user  inputs  with  a 
lightpen  or  touoh-aoreen  interface  may  be  miadireoted  by  vehicular  motion.  In 
contrast,  oursor  designation  via  a  trackball  osn  be  verified  independently  by 
the  user  prior  to  the  entry  of  that  data  into  the  system,  sinoe  the  mouse  key 
press  is  a  separate  entry  function.  Finally,  a  mouse/ trackball  or  parallel 
input  devloe  might  prove  more  workable  if  mounted  direotly  to  the  BMS  display 
rather  tnan  configured  as  a  separate  control  unit  as  in  this  evaluation. 
Ninety  three  peroent  of  all  users  requested  a  mounted,  rather  than  separate, 
mouse/traokball  configuration  if  this  input  system  is  implemented  CA— 1 1,533. 
In  conclusion,  the  speoifioatlon  of  a  BMS  input  devloe  requires  a  more  ex¬ 
tended  hands-on  evaluation  of  eaoh  candidate  oontrol  system  and  ideally  a 
field  setting  with  oross  oountry  movement. 


Radio  Features  and  Functions 

As  a  digital  burst,  operationally  seoure  mode  for  transmitting  both  text 
and  graphic  data,  BMS  is  expeoted  to  provide  a  powerful  alternative  to  voioe 
communications  over  the  FM  radio.  BMS  is  primarily  a  oommand  and  oontrol 
system  an'.'  should  become  the  preferred  mode  for  both  oritioal  and  sensitive 
data  tr  issions.  In  addition  to  its  role  as  a  baok-up  oommunioation  chan¬ 
nel,  hove'u ,  the  radio  may  remain  as  a  vital  "human"  link  between  soldiers 
engaged  in  deadly  and  often  isolating  combat  situations. 

For  this  evaluation  several  potential  BMS  functions  were  assessed  that 
might  support,  or  make  easier,  radio  frequency  and  ohannel  designation. 
Pressing  the  main  funation  key  entitled  "RADIO"  brought  up  a  display  page 
with  a  number  of  automated  functions.  The  design  of  this  page  was  tailored 
to  user  eohelon  levels  and  depicted  ohannels  or  nets  for  battalion-down  com¬ 
munications.  It  was  anticipated  that  BMS  should  automatically  dial  in  and 
update  both  primary  and  anti-jam  frequencies  in  aocordanoe  with  Communication 
Eleotronio  Operations  Instructions  (CEOI).  This  prototype  feature  was  in¬ 
tended  to  preprogram  and  automate  as  many  communication  operations  as  possi¬ 
ble.  Ninety-three  peroent  of  all  users  rated  this  funotlon  as  "useful"  to 
"very  useful"  [A-12,55]  and  96 t  indicated  that  the  display  layout  was  "clear 
and  easy  to  interpret"  [A- 12, 56].  The  value  of  this  function,  however,  may 
be  limited  to  conventional  fixed-frequency  systems,  and  less  useful  in  the 
case  of  more  modern  frequency  hopping  single  channel  ground/airborne  radio 
subsystems  (SINCGARS). 

In  addition,  97t  of  all  users  recommended  that  BMS  automatically  select 
the  receive-only ,  auxiliary  channel,  when  a  new  transmit/receive  net  is  des¬ 
ignated  [A-12,573.  A  review  of  the  results  provides  user  specifications, 


default  values,  for  this  automated  "aux"  setting  for  eaoh  of  the  following 
positions:  tank,  platoon  and  oompany  commanders,  platoon  and  first  ser¬ 
geants  . 


Blaok  and  White  Displays 

The  final  task  for  eaoh  respondent  was  to  reoonsider  the  portrayal  of 
map  features  provided  by  a  digitized  terrain  data  base  restricted  to  only 
blaok  and  white,  aohromatio  displays.  Users  operating  with  only  blaok  and 
white  (B/W)  displays,  requested  the  same  subset  of  features  be  automatically 
generated  that  they  had  ohosen  for  oolor  displays:  contour  lines,  roads, 
water,  vegetation,  and  towns  [A-13,61].  And  in  general  their  relative  rat¬ 
ings  of  importance  aoross  all  ten  features  were  unohanged  from  their  ratings 
for  ohromatlo  map  displays  [A«13,5S3.  But  the  blaok  and  white  display 
olearly  impairs  feature  disorJminability  and  map  interpretation.  Their  at¬ 
tempts  to  declutter  the  B/W  display  and  inorease  disoriminablllty  are  evident 
in  that  the  majority  of  ANCOC  and  BNCOC  students  requested  that  only  4  fea¬ 
tures  be  automatically  initialized  in  the  B/W  mode  oontrasted  with  the  5 
requested  on  the  oolor  displays  (water  was  exoluded),  and  in  the  lower  proba¬ 
bility  of  seleotlon  for  all  features. 

The  blaok  and  white  displays  were  tested  in  the  event  that  flat  panel 
technologies  have  not  developed  to  the  level  of  full  oolor  Jisplays  by  the 
1988  projected  BMS  milestones.  While  users'  preferenoe  for  oolor  was  nearly 
unanimous,  a  number  of  participants  reported  they  felt  oomfortable  with  B/W 
only  displays  and  that  B/W  was  a  viable,  if  least  preferred,  display  format. 
In  response  to  a  potential  trade-off  deoision,  69%  of  all  users  requested  a 
oolor  display  that  was  fixed  or  stationary  (given  the  extended  depth  of  a 
CRT-based  system)  over  a  more  portable,  presumably  tethered,  flat  panel  tech¬ 
nology  [A-1M,62], 

In  oonolusion,  the  interpretabllity  of  a  B/W  BMS  display  is  heavily  de¬ 
pendent  upon  the  feature/overlay  seleot  and  delete  funotion  previously 
disouased.  If  the  map  oan  be  repeatedly  "tailored"  to  eaoh  user  and  eaoh 
task  by  delimiting  the  display  to  only  the  smallest  set  of  relevant  terrain 
features,  then  a  B/W  or  monoohromatio  BMS  display  should  still  prove  a  power¬ 
ful  technology  for  enhanoing  command  and  control  of  Armor  operations. 


SUMMARY 


This  report  has  identified  a  preliminary  set  of  user  interface  require¬ 
ments  for  BMS.  The  goal  of  this  effort  was  to  ensure  that  fundamental  user 
requirements  were  included  in  the  earliest  stages  of  BMS  design  and  develop¬ 
ment.  To  provide  this  information  in  a  timely  manner  to  the  Project  Manager 
for  the  M1A1  Blook  II,  this  evaluation  has  attempted  an  initial  assessment  of 
a  broad  range  of  user  requirement  issues  for  BMS.  The  evaluation  addressed 
not  only  the  overall  size  and  configuration  of  the  BMS  base  display,  but  also 
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most  of  the  major  operating  features  and  control  functions  anticipated  for 
BMS.  Further  research  on  and  refinement  of  these  BMS  user  requirements  is¬ 
sues  is  clearly  needed. 

A  more  thorough  investigation  of  many  important  user  requirements  will 
require  refinements  to  the  BMS  interface  prototype.  As  discussed  previously 
future  efforts  will  require  tha^  a  number  of  limitetions  in  the  current  pro¬ 
totype  be  redressed  including:  automated  key  functions;  interactive  trans¬ 
missions;  enhanced  symbol  and  graphic  generation  features;  menu 
modifications;  and  simulation  of  oombat  dynamios  on  the  map  and  terrain  dis¬ 
play.  Most  importantly,  this  revised  interface  must  inelude  the  capability  of 
automatically  collecting  users'  input  and  reaction  times  in  relation  to  a 
scenario-driven  time  log.  This  would  allow  the  evaluation  of  objeotive  meas¬ 
ures  of  the  users'  speed  and  aoouraoy  of  response  via  BMS,  relative  to  con¬ 
ventional  or  base  line  performance  standards. 

Finally,  while  BMS  is  expeoted  to  significantly  enhanoe  oommand  and  con¬ 
trol  this  evaluation  has  underscored  the  faot  that  it  may  require  a  signifi¬ 
cant  ohange  in  the  users'  standard  operating  procedures,  suoh  as  the  shift 
from  vooal  (FM  radio)  to  non-vocal  communication  and  from  paper  maps  and 
conventional  overlays  to  digital  terrain  and  taotioal  displays.  Both  users 
and  designers  must  attempt  to  streamline  and  reformulate  these  standard  oper¬ 
ating  procedures  to  maximize  the  innovative  potential  of  BMS.  As  part  of 
BCD's  Blook  11  BMS  evaluation,  this  report  has  initiated  this  effort  by  ask¬ 
ing  users  to  speoify  both  their  ourrent  and  future  oommand  and  oontrol  re¬ 
quirements  given  the  automated  funotions  of  a  prototype  BMS. 
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APPENDIX  A 

USERS*  BMS  INTERFACE  QUESTIONNAIRE  AND  RESPONSE  DATA 


Mafc 

1.  Whan  using  oonvantionsl  military  maps,  how  important  ara  tha  following 
terrain  features.  Please  rank  these  features  from  1-10  with  1  indioating 
most  important  feature  and  10,  least  important. 

[Features  are  reordered  by  lmportanoe  ratings  aoross  entire  sample,  rather 
than  by  their  original  order  on  questionnaire.] 


AOAC 

ANCOC 

BNC0C 

ALL 

contour  lines 

1 

1 

1 

1 

roads 

2 

2 

2 

2 

vegetation 

3 

3 

3 

3 

water 

4 

4 

5 

4 

towns 

5 

5 

6 

5 

borders 

7 

6 

4 

6 

names  of  towns,  roads,  eto. 

6 

7 

7 

7 

ohu'ohes 

9 

8 

8 

8 

t  ewers 

8 

10 

9 

9 

power  lines 

10 

9 

10 

10 

2.  When  using  these  BMS  maps  on  your  display,  how  Important  are  the  follow¬ 
ing  terrain  features?  Please  rank  these  features  from  1-10  with  1  indioating 
most  Important  feature  and  10,  least  important.  (Assume  shading) 

[Features  are  reordered  by  lmportanoe  ratings  aoross  entire  sample,  rather 
than  by  their  original  order  on  questionnaire.] 


AOAC 

ANCOC 

BNC0C 

ALL 

oontour  lines 

1 

1 

1 

1 

roads 

2 

2 

2 

2 

vegetation 

3 

3 

3 

3 

towns 

7 

4 

4 

4 

water 

5 

5 

6 

5 

borders 

4 

6 

5 

6 

power  lines 

9 

7 

7 

7 

names  of  towns,  roads,  eto. 

6 

8 

10 

8 

ohurohes 

10 

9 

8 

9 

towers 

8 

10 

9 

10 
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3.  What  ohanges  or  improvements  would  you  reoommend  for  displaying  the  ter¬ 
rain  features  provided  by  BMS?  Write  in  your  recommendations  for  eaoh  of  the 
following:  [SEE  REPORT] 

4.  In  general,  are  there  any  other  terrain  features  that  you  feci  are  impor¬ 
tant  that  should  be  inoluded  on  the  BMS?  Please  list  those  below.  [SEE 
REPORT] 

5.  Do  you  like  the  feature  of  being  able  to  add  or  delete  seleoted  terrain 
features  on  the  map  display? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

No 

100* 

Ml 

100* 

83* 

17* 

97* 

3* 

6.  Would  you  like  this 
military  overlays  (opns 
play  map? 

feature 
,  threat 

to  inolude  ability  to  selectively  plaoe  your 
,  fire  support,  and  obstaoles)  onto  your  dis- 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

No 

100* 

100* 

100* 

100* 

7.  When  you  "initialize"  or  bring  up  the  map  display  for  the  first  time, 
which  of  the  following  terrain  features  do  you  think  should  be  automatically 
provided?  Please  oheok  only  those  features  you  want  automatically  provided, 
[•s  indioate  those  features  seleoted  by  at  least  a  majority  of  respondents 
in  that  group.] 

AOAC 

ANCOC 

BNCOC 

ALL 

roads 

a 

a 

a 

a 

vegetation 

a 

a 

a 

a 

towns 

a 

a 

a 

water 

a 

a 

a 

oontour  lines 

a 

a 

a 

a 

[Features  not  seleoted  by  a  majority  of  respondents  are:  borders,  power 
lines,  ohurohes,  towers,  names  of  towns,  roads,  eto.] 
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8.  In  general,  would  you  prefer  to  draw  In  the  following  graphlo  features, 
or  seleot  these  symbols  from  a  menu  and  looate  them  on  the  map. 


AOAC  ANCOC  BNCOC  ALL 


Operational 

graphios 

Draw 

64* 

73* 

17* 

58* 

Seleot 

36* 

27* 

83* 

42* 

Threat 

graphios 

Draw 

38* 

27* 

17* 

30* 

Seleot 

62* 

73* 

83* 

70* 

Fire  support 

graphios 

Draw 

33* 

36* 

17* 

31* 

Seleot 

67* 

64* 

83* 

69* 

Obataole 

graphios 

Draw 

43* 

27* 

17* 

33* 

Seleot 

57* 

73% 

83* 

67* 

9.  When  aeleotlng  elements  suoh  as  tanks  or  APCs  to  be  plaoed  on  the  map, 
would  you  prefer  to  seleot  from  a  menu  of  standard  military  symbols  or  from  a 
menu  of  piotare  images. 


AOAC 

ANCOC 

BNCOC 

ALL 

Symbols 

64* 

67* 

82* 

71* 

Plotures 

36* 

33* 

18* 

29* 

10.  When  these  same  elements  are  displayed  on  your  map,  would  you  prefer 
standard  military  symbols  or  pioture  images? 


AOAC 

ANCOC 

BNCOC 

ALL 

Symbols 

83* 

80* 

67* 

79* 

Pictures 

17* 

20* 

33* 

21* 

1 1 .  Whloh  of  the  oonventlonal  map  soales  would  you  prefer  to  use  most  as  a 
platoon  oommander,  as  a  oompany  oommander?  Rank  order  for  eaoh  position  from 
1-3.  [Map  soales  are  reordered  by  preference  ratings,  rather  than  by  their 
original  order  on  questionnaire.  NCOa  ranked  map  soales  for  TC,  PSQ,  and 
1SG.  ] 


[For  all  positions 
combined] 

AOAC 

ANCOC 

BNCOC 

1:50,000 

1 

1 

1 

1:25,000 

2 

2 

2 

1:125,000 

3 

3 

3 
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12.  Does  the  ability  to  ZOOM  in  and  out  appear  to  be  an  important  map  con¬ 
trol  feature? 


AOAC  ANCOC  BNCOC  ALL 

Yes  100$  100$  100$  100$ 

Mo  - 

13.  la  the  pan  funotion  that  allows  you  to  move  the  map  around  an  important 
map  oontrol  feature? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

100$ 

100$ 

100$ 

100$ 

Mo 

- 

- 

mm 

Is  the  centering 

funotion 

an  important  map 

oontrol  feature? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

100$ 

100$ 

100$ 

100$ 

No 

- 

- 

- 

- 

Reports 


15.  The  BMS  report  menu  Hats  six  different  reports  that  oan  be  oomposed  and 
transmitted.  How  frequently  are  theae  reports  used?  Would  you  rank  the 
following  reports  from  1-6  for  frequenoy  of  use  with  1  indioating  most  fre¬ 
quent  report  and  6,  least  frequent. 

[Reports  reordered  by  overall  frequenoy  ranks,  rather  than  their  original 
order  on  questionnaire.] 


AOAC 

ANCOC 

BNCOC 

ALL 

SPOT 

1 

1 

1 

1 

SITREP 

2 

3 

2 

2 

NBC  1 

3 

2 

3 

3 

SHELL 

4 

4 

4 

4 

NBC  4 

5 

4 

4 

5 
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MIJI 


6 


6 


6 


6 


16.  Are  there  any  additional  reporta  that  need  to  be  included  on  BMS?  [SEE 
REPORT] 


17.  Although  your  display  window  shows  the  current  taotieal  situation,  the 
report  elements  such  as  unit,  looation,  were  specified  to  ensure  that  reports 
would  be  complete  and  aoourate  messages.  Is  this  report  format  a  useful 


reminder  of  all  the 

information 

needed? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

92* 

100* 

67* 

89* 

No 

8* 

- 

33* 

11* 

18.  How  often  would  you  need  to  add  any  additional  detail  to  these  reports? 


Please  oheok  one  for  eaoh  type  of  report: 


SPOT 

NBC  1 

NBC  4 

SHELL 

SITREP 

MIJI 

Never 

28* 

62* 

59* 

34* 

27* 

48* 

[For  all  olasses 

oombined] 

Sometimes 

31* 

26* 

33* 

55* 

38* 

43* 

Often 

41* 

12* 

8* 

11* 

35* 

9* 

19.  What  types  of  detail  might  you  want  to  inolude  that  is  not  listed?  [SEE 
REPORT] 

20.  Would  you  recommend  that  BMS  inolude  a  keypad  with  a  few  keys  (single 
hand)  for  entering  additional  Information? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

92* 

64* 

33* 

69* 

No 

8* 

36* 

67* 

31* 

21.  Would  you  reoommend  that  BMS  inolude  a  complete  typewriter  keyboard  for 
entering  additional  detail  information? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

50* 

27* 

67* 

55* 

No 

50* 

73* 

33* 

45* 

22.  Is  the  location  of  this  display  area  for  reports  acceptable? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

75* 

100* 

83* 

86* 

No 

25* 

* 

17* 

14* 
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23.  Is  having  to  enter  data  on  up  to  five  menu  pages  to  complete  a  report  an 
aooeptable  number? 


AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

17* 

55* 

50* 

38* 

No 

83* 

45* 

50* 

62* 

24.  How  confusing  or 

easy  did 

you  find  stepping  through  the  menus  to  be? 

AOAC 

ANCOC 

BNCOC 

ALL 

Very  Easy 

8* 

36* 

33* 

25* 

Easy 

42* 

64* 

50* 

54* 

Confusing 

50* 

- 

17* 

21* 

Very  Confusing 

- 

mm 

- 

- 

25.  Are  there  times 

you  might  want  to 

send  partial  reports? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

100* 

91* 

83* 

93* 

No 

- 

9* 

17* 

7* 

26.  Did  the  summary 

page  provide  you  a 

oomplete  copy  of  the  message  you  are 

about  to  report? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

83* 

91* 

100* 

90* 

No 

17* 

9* 

- 

10* 

27.  Were  you  able  to 

edit  or 

ohange  these  reports  in  a  manner  that  you  found 

aooeptable? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yea 

67* 

90* 

83* 

79* 

No 

33* 

10* 

17* 

21* 

28.  Rarlk  order  (1-8),  in  order  of  importance,  those  elements  of  the  Spot 
Report  whioh  you  think  are  the  most  important  with  1  indioating  most  impor¬ 
tant  element  and  8,  least  important. 


[Elements  are  reordered 
than  by  their  original 

by  importance  ratings 
order  on  questionnaire. 

aoross  entire  sample,  rather 
] 

AOAC 

ANCOC 

BNCOC 

ALL 

enemy  size 

1.5 

1 

1 

1 

enemy  looation 

1.5 

2 

2 

2 

enemy  activity 

4 

2 

3 

3 

enemy  equipment 

5 

5 

4 

4 

obserer  ID 

3 

4 

5 

5 

your  aotivlty 

6 

6 

7 

6 

time  of  observation 

7 

7 

6 

7 

enemy  unit  ID  markings 

8 

8 

8 

8 

29.  If  you  are  working  on  a  report  and  get  interrupted,  where  would  you  like 
to  return  to  when  you  oontinue  working  on  that  report? 

AOAC 

ANCOC 

BNCOC 

ALL 

At  the  beginning 

85 

- 

335 

105 

Where  you  left  off 

425 

645 

505 

525 

Summary  page 

505 

365 

175 

•385 

30.  Given  the  menu  structures  in  BMS, 
be  listed?  Rank  order  from  1  to  3  with 

how  do  you  think,  the  menu  items  should 
1  indioating  your  first  preference 

and  3  your  last  preferenoe. 


[For  all  olasses 
oombined] 


Alphabetically 
By  frequency  of  use 
By  degree  of  importanoe 


JST 

2ND 

3RD 

155 

105 

755 

615 

395 

•m 

505 

355 

155 

Keys 


31.  Do  you  like  having  the  main  function  keys  appear  as  permanent  keys  on 
the  display? 


AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

92% 

91$ 

83$ 

90$ 

No 

8 $ 

9$ 

17$ 

10$ 

32. 

Reverse  video/ shading  was 

used  to 

indioate 

that  a  key  or  feature  had 

been 

seleoted.  Is  this 

reverse 

video  an 

Important  display  feature? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

92% 

100$ 

83$ 

93$ 

No 

8* 

- 

17$ 

7$ 

33. 

Would  you  prefer 

that  the 

label  for  a  key 

be  overlayed  on  the  key  or 

displayed  beside  the  key? 

AOAC 

ANCOC 

BNC0C 

ALL 

On  the  Key 

100$ 

100$ 

100$ 

100$ 

Beside  the  Key 

- 

- 

- 

3**. 

Could  key  labels 

be  easily  read  at 

eaoh  of 

the  available  display  sizes? 

AOAC 

ANCOC 

BNC0C 

ALL 

7"  Yes 

25$ 

50$ 

20$ 

33$ 

No 

75$ 

50$ 

80$ 

67$ 

8"  Yes 

73$ 

80$ 

80$ 

77$ 

No 

27 1 

20$ 

20$ 

23$ 

9”  Yea 

92$ 

100$ 

100$ 

96$ 

No 

8$ 

- 

- 

4$ 

35. 

Was  the  displayed  keypad 

for  entering  numerio  data  easy  to  use? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

92$ 

100$ 

100$ 

97$ 

No 

8$ 

*• 

- 

3$ 

36. 

Did  the  "delete" 

and  "clear"  keys 

allow  you  sufficient  control  for 

changing  data  entries? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yea 

100$ 

91$ 

100$ 

97$ 

No 

- 

9$ 

- 

3$ 

A-8 


Messages  and  Alerts 


37.  Do  you  like  having  a  permanent  area  or  window  on  the  display  that  indi¬ 
cates  incoming  information  suoh  as  warnings,  alerts,  and  reports? 


AOAC 

ANC0C 

BNCOC 

ALL 

Yes 

100* 

100* 

100* 

100* 

No 

- 

■a 

m 

- 

38.  Is  the  looation 

of  this  information  on  the 

BMS  display  acceptable? 

AOAC 

ANC0C 

BNCOC 

ALL 

Yes 

92* 

100* 

100* 

97* 

No 

8* 

- 

- 

3* 

39.  After  being  prioritized,  the  BMS  ourrently 

displays  information  in  the 

order  reoeived,  would 

you  like 

the  option  to  select  the  order  of  information 

to  be  displayed? 

AOAC 

ANC0C 

BNCOC 

ALL 

Yes 

100* 

82* 

100* 

93* 

No 

- 

18* 

- 

7* 

40.  In  order  to  not 

write  over 

ourrent 

displayed  information,  the  BMS  does 

not  display  inooming 

information  until 

you  touoh  the  reoeive  key.  Do  you 

like  this  feature? 

AOAC 

ANC0C 

BNCOC 

ALL 

Yes 

83* 

91* 

83* 

66* 

No 

17* 

9* 

17* 

14* 

41.  Would  you  like  the  system 

to  automatically 

acknowledge  for  you  when  you 

reoeive  a  message  and 

1  touoh  the 

reoeive 

key? 

AOAC 

ANC0C 

BNCOC 

ALL 

Yes 

50* 

73* 

67* 

55* 

No 

50* 

27* 

33* 

45* 

42.  Should  any  visual  signal  used  for 

alerts  or  Incoming  messages  be  a 

blinking  or  flashing  signal  to 

insure  they  are 

detected? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yes 

b7* 

100* 

100* 

86* 

No 

33* 

- 

- 

14* 

A-9 


43.  Would  you  like  an  additional  alerting  oue  suoh  as  an  audible  beep  or 
buzzer? 


AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

75* 

91* 

100* 

86* 

No 

25% 

9* 

- 

14* 

44. 

Is  this  permanent  message 

area  neoessary 

for  any  other  information?  If 

so,  what  kinds  of  information: 

[SEE  REPORT] 

Date, 

Time 

45. 

Is  the  data  displayed  in 

the  Date, 

Time  window  in  an  aooeptable  format 

or  arrangement? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

92% 

100* 

100* 

97< 

No 

8* 

- 

M 

3* 

46. 

Should  you  have  the  flexibility  to 

plaoe 

A  or  Z  after  time  to  refleot  if 

time 

is  in  alpha  or  zulu? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

62% 

91* 

100* 

89* 

No 

18* 

9* 

- 

11* 

47. 

Should  this  Date, 

Time  information 

be  provided  continuously? 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

92% 

91* 

100* 

93* 

No 

8* 

9* 

- 

7* 

48. 

Is  the  Date,  Time 

group  information  displayed  in  am  aooeptable  looation? 

1 

AOAC 

ANCOC 

BNC0C 

ALL 

Yes 

\  100* 

100* 

100* 

100* 

No 

- 

- 

- 

- 

49.  How  useful  would  a  time  function  be  that  allowed  you  to  monitor  progress 
of  operations  with  respect  to  baokward  planning?  (Exp:  H-90,  H,  H+24) 


AOAC 

ANCOC 

BNC0C 

ALL 

Very  Useful 

33* 

45* 

80* 

47* 

Useful 

42* 

64* 

- 

32* 

Not  Useful 

25* 

18* 

20* 

21* 
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50.  Is  there  any  additional  information  you  would  like  to  have  displayed  in 
the  Date,  Time,  area?  Please  speoify  below.  [SEE  REPORT] 


Input  Devloea 


This  BMS  prototype  used  a  traokball  for  positioning  the  oursor  and  a 
mouse  for  triggering  data  inputs. 


51.  In  general,  were  these  input  devioea  easy  to  use? 


AOAC 

ANCOC 

BNC0C 

ALL 

Mouse 

Yes 

58* 

80* 

80* 

71* 

No 

42* 

20* 

20* 

29* 

Traokball 

Yes 

25* 

55* 

83* 

48* 

No 

75* 

45* 

17* 

52* 

52. 

Was  the  traokball  oontrol 

aoourate 

enough 

for  the 

following  funotiona? 

AOAC 

ANCOC 

BNC0C 

ALL 

Seleoting  Menus 

Yes 

58* 

82* 

67* 

69* 

No 

42* 

18* 

33* 

31* 

Drawing 

Yes 

25* 

27* 

33* 

28* 

No 

75* 

73* 

67* 

72* 

Looating  Objects 

Yes 

50* 

82* 

67* 

66* 

on  the  Map  No 

50* 

18* 

33* 

34* 

53. 

Would  you  prefer  that 

i  the 

mouse  and  traokball  controls  be  configured  as 

a  separate  oontrol  unit  as 

i  they  were  for  this  ' 

demo  or 

that  they  be  mounted  on 

the 

side  of  the  BMS  devloe? 

AOAC 

ANCOC 

BNC0C 

ALL 

Separate  Unit 

8* 

- 

17* 

7* 

Mounted  Unit 

92* 

100* 

83* 

93* 

A-11 


54.  Prioritize  your  preferences  for  the  following  input  devloes  for  develop¬ 
ing  your  graphics  and  overlays  on  the  BMS  display.  Rank  from  1-4. 


Touoh  sensitive  soreen 

Light  pen 

Traokball/mouse 
mounted  to  BMS 

Traokball/mouse  separate 
oontrol 


AOAC 

1 

2 

3 


ANCOC  BNCOC  ALL 


1 

2 

3 


1 

2 

3 


1 

2 


Radio 


The  radio  display  was  designed  to  provide  an  automated  means  for  determining 
and  pre-setting  both  the  primary  and  anti- jam  frequencies. 

55.  How  useful  is  the  oapability  for  automatically  determining  your  radio 
frequencies? 


AOAC 

ANCOC 

BNCOC 

ALL 

Very  Useful 

91* 

82* 

50* 

79* 

Useful 

- 

9* 

50* 

14* 

Not  Useful 

9* 

9* 

- 

7* 

56.  Is  the  display 

layout  for 

preseleoted  frequencies  dear  and 

terpret? 

AOAC 

ANCOC 

BNCOC 

ALL 

Yea 

91* 

100* 

100* 

96* 

No 

9* 

- 

4* 

The  radio  funotlona  also  provide  automated  seleotion  of  the  receiving  net  or 
channel  when  a  new  net  or  channel  has  been  selected  on  your  R/T. 

57.  How  useful  is  this  automated  seleotion  of  a  receiving  ohannel  useful, 
provided  the  user  oan  override  the  system  when  desired? 


AOAC 

ANCOC 

BNCOC 

ALL 

Very  Useful 

91* 

82* 

83* 

86* 

Useful 

- 

18* 

17* 

11* 

Not  Useful 

9* 

• 

- 

3* 

58.  In  general,  what  net  would  you  want  selected  for  receiving  given  the 
following  selections  for  transmit/receive?  [SEE  REPORT] 
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Blaok  and  White 


59.  When  using  these  BMS  maps  on  your  display,  how  Important  are  the  follow¬ 
ing  map  features?  Please  rank  these  features  from  1-10  with  1  indicating 
most  Important  feature  and  10,  least  important.  (Assume  Shading) 

[Features  are  reordered  by  importance  ratings  aoross  entire  sample,  rather 
than  by  their  original  order  on  questionnaire.] 


AOAC 

ANCOC 

BNCOC 

ALL 

'  1 

oontour  lines 

1 

2 

1 

1 

roads 

2 

1 

2 

2 

vegetation 

3 

3 

3 

3 

towns 

4 

4 

4.5 

4 

water 

5 

5 

6 

5 

borders 

6 

6 

4.5 

6 

ohurohes 

10 

7 

7.5 

7 

power  lines 

7.5 

8.5 

9 

8 

names  of  towns, 
roads,  eto. 

7.5 

8.5 

10 

9 

towers 

9 

10 

7.5 

10 

60.  What  ohanges  or  improvements  would 

you  reoommend  for  the  oultural  faa 

tures  provided  by  BMS  if  only  blaok  and 

white  is 

available?  Write  in  your 

recommendations  for  each 

of  the  following:  [SEE  REPORT] 

61.  When  you  "Initialize"  or  bring  up  the  map  display  for  the  first  time, 
whioh  of  the  following  oultural  features  do  you  think  should  be  automatically 
provided  when  only  blaok  and  white  is  available.  Please  oheok  only  those 
features  you  want  automatically  provided. 

[ *s  lndloate  those  features  selected  by  a  majority  of  respondents  in  that 
group . ] 

AOAC  ANCOC  BNCOC  ALL 


roads 
vegetation 
towns 
water 
contour  lines 


e 

t 


* 

« 

t 


[Features  not  seleoted  by  a  majority  of  respondents  are:  borders,  power 
lines,  churches,  towers,  names  of  towns,  roads,  etc.] 
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62.  If  you  had  to  ohooae  between  a  black  and  white  display  that  could  be 
moved  around  the  tank  or  a  color  display  that  was  looked  to  a  fixed  position, 
which  would  you  prefer? 


AOAC 

ANCOC 

BNCOC 

ALL 

Pixed  Color 

55* 

82* 

67* 

69* 

Movable  B/VJ 

45* 

18* 

33* 

31* 

63.  In  what  location  do  you  think  the  BMS  display  would  be  moat  effeotive 
when  you  are  in  the  following  positions:  [SEE  REPORT] 


APPENDIX  B 

PROTOCOL  RECORD  OF  USERS'  COMMENTS 


INTRODUCTION 


This  protocol  seotlon  is  a  reoord  of  all  users'  comments  and  recommendations 
expressed  during  their  individual  sessions  while  working  with  tha  BMS  proto¬ 
type  displays  and  oontrols.  These  responses  were  recorded  to  ensure  that  any 
unanticipated  insights  or  problems  emerging  from  the  users  aotual  experienoe 
with  the  prototype's  features  and  funotions  were  oaptured.  In  addition ,  the 
protocol  reoord  was  maintained  (1)  to  avoid  foroing  users  into  inoomplete  or 
inaccurate  specification  due  to  question  wording  on  the  structured  question¬ 
naire  (see  Appendix  A). 

The  protoool  reoord  submitted  is  basically  a  verbatim  transoript  of  the  users 
responses  as  expressed.  Rewording  was  limited  to  (1)  summations  aoross  users 
when  more  than  one  respondent  provided  the  same  recommendation  and  (2)  provi¬ 
sion  of  referents  assumed,  therefore  not  spoken,  by  the  users  working  with 
and  pointing  directly  to  the  various  display  and  oontrol  features  (see 
Figures  1-4). 


The  reoord  also  provides  an  index  of  frequenoy  and  source  for  eaoh  of  the 
oomments  entailed.  The  ALL  oolumn  refers  to  the  total  sample  combined  aoross 
all  subgroups  (AOAC,  ANCOC,  BNCOC)  and  frequenoy  data,  the  number  of  subjeots 
making  this  oomment,  is  provided  in  the  same  oolumn.  Remaining  oolumns  in  the 
protoool  reoord  refleot  similar  oomments  expressed  by  the  Joint  Working  Oroup 
(JWQ)  of  DCD;  and  the  OTHER  oolumn  lnoludes  similar  ruoommendations  by  SMEs 
in  Land  Battle  Test  Bed  area  or  experienced  with  related  JMS  teohnologies. 


This  protocol  reoord  la  organized  around  the  main  BMS  display  areas  and 
oontrols  tested  and  this  sequenoe  corresponds  to  the  order  in  whioh  they  were 
evaluated  by  eaoh  user. 
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ALL 

JWG 

OTHER 

MAP 

A.  Terrain  Features. 

1.  Include  railroads. 

4 

• 

2.  Include  water. 

A.  Further  differentiate  swaaps/narsh  area. 

19 

3 

• 

3.  Shade  In  vegetation  yet  still  be  able  to 
see  oontour  lines  and  grids  in  wooded  areas. 

21 

• 

4.  Inolude  queries  and  depreaslons. 

6 

5.  In  oolor  display  show  border  with  thioker 
line. 

4 

6.  Inolude  ohurohes  with  towns. 

4 

7.  Inolude  fuel  resources  like  gas  stations/ 

POL  dumps. 

1 

8.  Relooate  gridline  button  to  menu  of  asp 
features. 

4 

a 

• 

9.  Put  zoom  and  soroll  funotlon  on  same  menu  pago. 

1 

* 

10.  As  additional  feature  show  terrain  at  as 
oblique  view  (3D). 

3 

11.  Color  for  roads  is  too  bright  and  over* 
powers  oontour  lines. 

1 

12.  Shade  in  towns  in  solid  oolor. 

17 

t 

13.  Be  able  to  revolve  asp  to  orient  it  to 
dlreotlon  you  are  moving. 

• 

• 

14.  Conoerned  over  how  many  1  over  world  soale 
grid  sheets  along  with  1:50,000  and 

1:25,000  representation  of  those  grid 
sheets,  computer  oould  hold  on  one  tape 
before  you  had  to  insert  another  tape. 

1 

15.  Use  a  paper  map  format  with  white  background, 
brown  oontours. 

13 

16.  Be  able  to  dim/brighten  odors  or  shades 
of  a  color  so  overlay  graphios  like  ob¬ 
stacles  does  not  blend  In  with  vegetation. 

5 

a 

B-2 

ALL  JWO  OTHER 

17.  Use  other  oolor  than  red  to  show  towns — enemy  4 
is  In  red. 

18.  Have  BMS  assist  tank  oommander  (TC)  in  terrain  1 
analysis-show  key  terrain  obstacles  (NO  00, 

SLO  00,  00). 

19.  Inolude  bridges  and  their  olassifioations.  2  * 

20.  Have  display  alert  you  when  you  reaoh  a  1  * 

1:50,000  and  1:25>000  map  soale  in  display 

window  as  you  zoom  in. 

21.  Inolude  more  roads  (i.e.  red  balls,  oandy,  13  tt 

stripes,  white  balls,  trails). 

22.  Ensure  BMS  has  capability  that  as  you  zoom  17  *  * 

in  from  a  1  over  world  area  when  you  reaoh 

a  1:50,000  area  more  detail  (as  on  a 
1:50,000  paper  map)  would  automatically 
appear  on  display  and  if  you  further  zoomed 
in  to  a  1:25,000  area  more  detail  would 
appear  on  your  terrain  display  (as  shown  on 
1:25,000  paper  map). 


23.  Inolude  keys  for  "names  of  towns",  "key  1  * 

terrain",  "roads,  eto." 

24.  Power  lines  not  nseded.  1 

25.  Inolude  oontour  numbers  for  elevation.  3  * 

26.  Inolude  rice  paddies  (Korea).  1 

27.  Be  able  to  display  road  numbers.  1  * 

28.  Use  other  symbol  for  ohurohes  than  +  3 

whioh  oan  be  confused  for  target  referenoe 
points(TRP’S). 

29.  Show  symbol  for  paved  lanes  as  they  are  on  1  * 

a  paper  map. 

30.  Inolude  as  menu  items  the  names  of  water  1  * 

features. 

31.  Inolude  airfields.  1 

32.  Inolude  gas  pipelines.  1 

33.  Change  blue  oolor  of  border  to  another  oolor  2 
so  as  not  to  oonfuse  with  water. 
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34.  Relooate  "grid"  button  to  culture  item  mem.  2 

35.  Inolude  regional  features  dependent  on  what  1 

region  you  are  in  (l.e.  Korea-rioe  paddies, 
river  fords,  FRQ-vineyards,  PMT-depresaiona) . 

36.  Have  menu  showing  various  map  soale  buttons  so  1 
you  oan  quickly  go  to  an  area  and  get  1:250,000, 
1:50,000,  or  1:25,000  view  at  it. 

37.  Incorporate  option  to  allow  TC‘s  to  ohange 
oertain  oolors  due  to  red/green  oolor  blindness, 
or  working  under  red  light  conditions  (or  give 
optional  oolors). 

38.  Must  have  ability  to  easily  overlay  (draw  or 
type)  soaled  paper  overlays  onto  digital  map. 
and  they  require  slmlliar  digital  map  soallng 
and  detail. 

39.  Deolutter  feature  to  selectively  overlay  grids 
oulture  features  and  graphio  overlays  required. 

40.  Map  display  window  needs  to  be  a  size  so  that 
at:  1:250,000  soale  you  have  30  x  30  KMS 

1:50,000  soale  you  have  6x6  KMS 
1:25,000  soale  you  have  3  x  3  KMS 

41.  Be  able  to  differentiate  height  or  stories  of 
buildings  and  whether  they  have  basements. 

42.  As  a  minimum  the  oomputer  needs  to  have  stored 
five  map  sheets  with  the  oenter  map  oovering 
your  area  of  operations. 

B.  Free  Draw  or  Seleot  Funoltons 

1.  More  responsive  freedraw  capability  required,  17 
l.e.  with  touoh  sensitive  soreen,  seleot  ink 
oolor  then  draw,  when  finished,  touoh  a  finish 
button  or  have  oomputer  automatically  stop  draw 
funotion  ten  seoonda  from  last  item  drawn. 

With  map  seleot  ink  and  draw  when  button 
pressed;  stop  drawing  when  button  released; 
begin  again  when  button  pressed. 

2.  Incorporate  a  responsive  eraser  funotion  to  17 
erase  any  overlay  graphios  but  not  remove 
terrain  culture  (i.e.  have  eraser  button  and 

when  touched,  you  then  go  baok  and  erase 
errors) . 
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3.  Teach  BMS  oomputer  friendly  and  threat  units  5 
so  if  you  put  three  tasks  together  on  your 
terrain  display  it  will  display  symbols  or 
piotures  to  a  military  symbol  for  a  Soviet 

PLT, 

4.  Be  able  to  shrink/ enlarge  symbols  or  piotures  9 
plaoed  on  map  display  (manually  and/or 
automatically) . 

5.  More  oolors  than  blue,  green  and  red  need  to  1 
be  available  for  free  draw. 

6.  Free  draw  oolors  need  to  be  more  readable  over  2 
oulture  (reostat  function). 

7.  If  seleoting  from  a  menu,  be  able  to  seleot  1 

symbol  oolor  when  putting  item  on  terrain 
display  (Threat-red,  targets-blue ,  Obstacles- 
grcen/red). 

8.  Incorporate  a  permanent  Joystiok  to  soroll  map  1 
with  zoom  button  on  top  of  Joystick. 

9.  More  responsive  add  item  from  menu  oapability. 

Be  able  to  seleot  menu  item  and  keep  adding 
that  item  to  terrain  display  without  eaoh 
time  going  back  to  the  menu. 

10.  Be  able  to  seleot  from  menu  different  types 
of  lines  (l.e.  solid,  dotted,  olassed,  and 
then  free  draw  having  that  type  line. 

11.  Incorporate  note  pad  or  ollp  board  to  have 
ability  to  use  free  text  or  format 
non-standard  reports. 

12.  Ability  to  indioate  direotion  enemy  target 
is  faoing  or  moving  on  terrain  display. 

13.  Capability  of  system  to  maintain  on  terrain 
display  and  soale  free  drawing  symbols  on 
items  and  menu  aeleoted  items  as  you  zoom, 
pan,  and  soroll  the  map. 


a 


» 


a 


a 


a 


a 


a 
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C.  Zoom,  Pan,  Soroll  Funotions 

1.  Grid  numbers  need  to  be  placed  along  two  16 

flanks  of  map  display  window  at  all  times 
when  grids  are  overlayed  on  map. 
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2.  Retitle  soroll  buttons  Ilka  nN,  W,  E,  S"  or 
"nap  right,  map  left,  map  up,  map  down"  or 
"view  up,  view  down,  view  left,  view  right" 
to  maintain  orientation  if  map  moves  or 
view  moves  or  symbols. 

3.  Be  able  to  move  map  with  hand  through  touoh 
sensitive  soreen. 

4.  New  oontlnuous  funotion  (see  map  slowly 
move)  for  oentering  funotion  to  maintain 
orientation. 

5.  Have  oontlnuous  soroll  funotion  when  button 
pressed,  stop  when  button  released. 

6.  Have  oontlnuous  zoom  in  at  funotion. 

7.  Combine  zoom  and  soroll  funotion  onto  one 
menu  and  Instead  of  two  permanent  zoom/soroll 
buttons,  just  have  one  button. 

8.  Cursor  should  move  with  item/ feature  being 
oentered . 

9.  Line  of  and  time  distanoe  funotion  is  of  great 
value.  Must  be  able  to  perform  this  funotion 
in  any  map  scale. 


REPORTS 

1.  Include  logistlo  and  personnel  status 
reports  (Y1,  Y1A,  Y2,  Y2A,  Y3,  Y3A,  R2, 

R3). 

2.  Use  oommon  format  for  all  reports  (i.e. 

A-who,  B-what,  C-where,whom,  D-aotivity). 

3.  Be  able  to  fill  ir  report  lines  by  aotually 
writing  in  entry  through  a  touoh  sensitive 
soreen. 

4.  An  additional  detail  item  to  a  SPOT  REPORT 
is  what  you  think  the  enemy  might  do. 

5.  Plaoe  menu  window  on  left  hand  side  of  display 
(student  is  left  handed). 

6.  Would  like  to  see  report  summary  first  to  free 
write  in  report  entries. 


7.  Prioritize  all  report  line  entries  and  display 
high  priority  lines  first  with  send  button, 
(abbreviated) 

8.  Eaoh  report  line  or  prompt  needs  to  be  more 
notioable. 

9.  Likes  the  format  for  oomplete  report  where 
one  does  not  have  to  pull  out  a  manual  to  get 
format . 

10.  Additional  detail  items  for  a  SPOT  or  SITREP 
is  type  of  threat  velooity  and  elaborate  more 
on  my  oourse  of  aotion. 

1 1 .  Redesign  the  report ,  menu  entries  for  greater 
olarlty  and  aoouraoy  (e.g.,  reduce  entries, 
more  menu  options,  units  of  measure). 

12.  Would  like  ability  to  erase  terrain  map  display 
to  use  entire  soreen  to  format  oertaln  reports 
where  terrain  map  not  applicable;  yet  still 
have  quiek  map  return  baok. 

13.  Reports  take  too  long  stepping  through,  too 
many  menus  to  oomplete.  On  time  oonetralned 
situations,  digitized  report  must  be  done 

in  less  or  equal  time  as  it  would  be  to  do 
them  with  voice  oommo  and  soratoh  pad. 

14.  On  reports  that  have  line  entry  for  time,  show 
along  with  keypad  in  menu  a  button  labeled  TIME 
NOW  and  when  pressed  would  take  DTU  from  top 
display  window  and  stamp  it  in  as  line  entry. 

15.  Utilize  a  polloe  oode  format  for  seleotion  of 
report  line  entrya  (e.g.,  "10-52  is  request 
ambulanoe,  eta."). 

16.  Incorporate  a  printer  at  battalion  headquarters 
for  SI,  S4,  S2,  S3,  FSO,  eto.  and  BMS  Identifies 
messages  inooming  by  staff  seotion  they  go  to. 

17.  Integrate  map  as  part  of  reports, 

18.  Fit  report  summaries  onto  one  menu  page. 

19.  Include  a  soratoh  pad  at  end  of  all  reports  for 
remarks . 


20.  File  messages  by  time. 
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21.  Have  BMS  automatically  time  atamp  each  report  1 
when  it  la  aant  and  Input  your  oall  sign 

(when  you  preaa  aend  button  or  if  on  auto  when 
BMS  aenda  It  forward). 

22.  Capability  to  aend/reoelve  reporta  In  graphic,  9 

alphabetioal/numerioal  or  both— either 

manually,  automatically  or  a  combination. 

23.  Xnolude  road  maroh  order.  9 

24.  Ability  to  edit  inooming  reporta  aa  to  what  9 

items  on  the  report  you  want  permanently 

displayed  onto  your  digital  map,  what  itema 
you  do  not  want  displayed,  what  to  dump  and 
what  to  store. 


KEYS 

1.  Problem  to  read  key  labels  at  about  24"  away  7 
on  8"  display,  abbreviate  key  labels. 

2.  Relabel  "oulture"  button  aa  "features".  1 

3.  Relabel  "UTM"  button  as  "Grids".  12 

4.  Need  to  have  permanent  esoape  button  or 
funotlon  to  quiokly  exist  from  any  menu  and 
either  oanoel  that  menu  funotlon  or  hold  it. 

5.  Color  oode  your  permanent  keys  (i.e.  Contaot- 
red,  NBC-yellow,  Call  For  Fire-red,  eto. 


MESSAGES  AND  ALERTS 

1.  In  message/alert  window  when  BMS  receives 
report  it  shows  SPOT  C24,  BMS  automatically 
tells  sender  BMS  message  received  and  sender's 
display  shows  RECEIVED  B66.  When  user  press 
spot  box  it  displays  message  with  sender's 
terrain  display  (maybe  at  this  point  show  on 
sender's  display  VIEW)  and  if  satisfied  with 
report  user  presses  ACKNOWLEDGE  button  and 
sender's  display  shows  ACKNOWLEDGE  B66. 

2.  Never  confuse  acknowledge  for  reoeived  message.  12 


OTHER 


t 


t 


B-8 


i ' 
■jf 

ft. 

r“ 

ALL 

JWG 

■ 

OTHER 

S 

3.  Ensure  audible  alert  over  CVC  has  distinot  tone 
not  to  oonfuse  with  NBC  over  pressure  failure  or 
chemical  warning;  and  sound  does  not  interfere , 
out  out  or  distort i  voioe  oonmunioation.  Make 
it  a  pleasant  tone. 

4 

j 

4,  Reoonunenda  display  area  to  also  display  his 
tank  fire  oontrol  requirements  (i.e. 
temperature,  evaluation,  humidity). 

2 

5.  Have  light  blin/  at  driver's  station  to  alert 
for  inooming  messages. 

1 

6.  Xndioate  map  level  in  this  window  area. 

1 

v. 

7.  Ability  to  let  TC  prioritize  inooming  messages 
by  type  report  or  unit  (i.e.  BN  CDR  oan  have 
spot  reports  as  first  priority  or  all  reports 
from  AO  first  priority)  label  priorities  "Flash" 
"Flash  Override",  eto. 

1 

9 

a 

> ' 

•Y 

DATE/TIME 

■ 

• 

1.  Inolude  month  into  this  window  area. 

3 

«■* 

/■V 

•  .* 

* 

2.  Ability  for  system  to  automatically  refleot 
another  time  zone  if  you  tell  it  what  oountry 
(or  state)  you  are  in. 

2 

" 

3.  Incorporate  alarm  clock  function  and  TC's 
ability  to  input  his  desires  (i.e.  make  sleep 
plus  time  events;  time  to  sunrise,  sunsst, 
moon  rise,  eto.). 

1 

ff 

« 

4.  Distinguish  time  as  either  Alpha  or  Zulu. 

« 

— 

5.  Capability  to  incorporate  baokward  planning 
with  time  and  alert  funotion  for  events. 

t 

*“  * 

INPUT  DEVICES 

,v 

• 

1.  Need  a  touoh  sensitive  capability  for 
touching  keys  and  free  draw  capability. 

13 

• 

*{1 

.  *K 

2.  Prefer  Joystick  over  trackball,  with  mouse 
button  on  stiok. 

5 

‘:C 

i 

A 

3.  Have  ability  to  remotely  scramble/destroy  BMS 
on  another  vehiole  if  captured  or  abandoned. 

2 
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4.  Have  a  voice  aotuated  display. 

5.  Have  clear  plaatio  shield  you  oan  quiokly  drop 
or  dose  over  display  so  bunping  against  it 
does  not  mess  up  touoh  sensitive  display. 

6.  Computer  processing  speed  needs  to  be  just  as 
quiok  when  soreen  is  oluttered  as  when  it  is 
blank. 


RADIO 

1.  Function  to  preset  radios  is  not  ncoesaary. 

2.  Frequency  numbers  need  to  be  larger  to  read 
more  easily. 

3.  Have  BMS  alert  TC  if  a  party  on  his  receive/ 
transmit  net  (R/T)  is  Isolated  due  to  radio 
problems  or  off  the  net. 

4.  Incorporate  CEOI  into  BMS  so  the  oomputer  will 
automatically  set  your  R/T'a,  authentication 
oall  sign's,  frequency,  eto. 

5.  If  someone  goes  to  anti* jam  (A/J)  have  indicator 
or  other  party  displays  on  that  net  if  in  A/J 
mode.  Maybe  using  reverse  video. 


BLACK  and  WHITE 

1.  Show  border  with  thioker  line. 

2.  Inolude  ohurohes  with  towns. 

3.  Shade  in  vegetation,  yet  still  see  oontour 
lines  and  roads  in  wooded  areas. 

4.  Inolude  water. 

5.  Inolude  fuel  resources  like  gas  stations, 

POL  dumps. 

/ 

6.  Relocate  grid  line  button  to  be  in  menu  of  map 
feature  items. 

7.  Be  able  to  distinguish  overlay  graphics  from 
map  oulture  features. 

8.  Shade  in  towns. 


9*  Must  be  eble  to  differentiate  between  rivers, 
white  ball  roads  and  oontours. 

10.  Have  reostat  feature  to  dla/brighten  oultural 
features  and  overlay  graphios. 

11.  Have  display  alert  you  as  you  zoom  in,  when 
you  reaoh  a  1:50,000  map  soale  area  in  terrain 
window  and  1:25,000  area. 

12.  Inoludti  more  roads  (redballs,  oandy,  stripes, 
white  balls,  eto.). 

13.  Try  a  blaok/white  paper  map  with  white 
baokground . 

14.  Display  power  lines  as  they  are  on  a  paper  map. 

15.  Inolude  names  of  water  bodies. 

16.  Display  roads  as  dashed  (— )  lines. 


DISPLAY  LOCATION 

1.  If  TC  fully  in  turret,  locate  display  to 
right  front  of  TC. 

2.  If  TC  head  out,  looate  display  at  right 

front  (same  as  number  one  but  with  tilt  funotlon 

3.  If  TC  shoulders  out,  looate  display  same  as 
number  2. 

4.  Have  fixed  oolor  display  with  tethered  blaok/ 
white  display. 

5.  If  TC  fully  in  turret,  looate  display  to  left 
of  TC  suspended  on  braoket  with  tilt  funotlon 
from  turret  oeiling. 

6.  If  TC  head  out,  looate  display  same  as  number 
5  with  tilt. 

7.  If  TC  shoulders  out,  looate  display  same  as 
number  5  with  tilt. 

8.  If  TC  fully  in  turret,  looate  right  of  TC  near 
TC  over  ride. 

9.  If  TC  head  out  or  shoulders  out,  looate  to 
front  of  TC  above  range  finder. 


10.  If  TC  shoulders  out  looste  st  Commander's 
weapon  station  with  tilt  funotion. 

1 1 .  For  M2/M3  mount  display  between  radios  for 
all  TC  positions. 

12.  For  M2/M3  mount  display  right  side  of  TC 
above  ooax  doors  for  all  TC  positions. 

13.  For  all  3  TC  positions,  looate  display  on 
mount  from  turret  oeillng  right  side  of 
TC  position  with  tilt  funotion. 

14.  Plaoe  display  on  swing  arm  for  M2  and  M3 
Bradley. 

15.  If  TC  shoulders  out,  looate  display  left  of 
TC  on  flex  arm  mounted  to  oolumn  support. 

16.  Display  needs  to  be  easily  referened  from  all 
three  TC  positions,  and  yet  oan  be  moved  or 
folded  out  of  the  way. 


GENERAL  COMMENTS 

1.  Even  though  through  evaluation  you  will  find 
oertain  preferences  by  position  (tailoring), 
still  incorporate  flexibility  to  allow 
individuals  to  tailor  funotlons  to  themselves. 


FIRE  SUPPORT 

1.  By  pushing  "Call  For  Fire”  button  and 
touohing  map  display  have  quiok  request 
for  fire.  Let  BMS  compute  range,  direotlon 
and  looatlon;  show  friendly  element,  time 
stamp,  oall-I.D.  by  integrating  BMS  into  nav 
system,  LRF,  fire  oontrol  system,  CEOI,  oommo 
system. 

2.  Display  with  oomputer  oan  interfere  with 
TACFIRE  and  FATDS. 


POSITION  LOCATION 


1.  Projeot  on  display  realtime  position  looatlon 
of  your  vshlols  and  other  friendly  elements 
of  unit  (i.e.  for  platoon  leader  his  vehiole 
and  his  platoon  vehiole)  for  oompany  oommander 
his  vehiole,  the  exeoutive  offloers  and  the 
platoon  vehiole;  for  battalion  oommander  his 
vehiole  the  S3's  and  all  oompany  vehloles. 

2.  Projeot  on  display  positions  of  known  or 
estimated  enemy  looations. 

3*  Capability  to  template  threat  forces,  their 
order  of  battle  and  weapon  systems. 


STATUS 

1.  Capability  for  graphlo  and  alphanumeric 
status  of  all  olaases  of  supply. 

2.  Provide  interfaoe  with  the  Standard  Army 
Retail  and  Supply  System  (SARSS). 

3.  For  personnel: 

"alphanumeric  status  of  personnel  status, 
-interfaoe  with  the  Standard  Installation 
Personnel  Reporting  System  (SIDPERS). 
"ability  for  display  and  computer  to  read 
digital  dogtag. 

4.  For  Maintenance: 

"manual  and  automatio  input  of  vehiole 
maintain  status  to  lnolude  all  vehiole 
systems,  (i.e.  weapon,  oommo,  fuel), 
"interfaoe  with  Standard  Army  Maintenance 
System  (SAMS). 

•automatically  maintain  logbook  reoords  or 
provide  oertain  input. 


INTEROPERATIVE  PARTS 


1.  Ability  to  aooept  peripheral  printer. 

2.  Ability  to  aooept  typewriter  key  board  or 
single  hand  key  pad. 

3.  Ability  to  aooept  peripheral  training  devioes. 
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4.  Ability  to  interfaoe  with  UCOFT  and  other  * 

training  teohnologiaa. 

TRAINING 

1.  Etabedded  systems  operations  guide  * 

(TM-10,-20,-30). 

2.  Eta  bedded  systeas  diagnostic  and  M 

troubleshooting. 

3.  Eta  bedded  tutorials.  tt 

M.  Capability  to  oonduot  lnteraotive  * 

soenarlos . 

5.  Htabedded  oheoklists  and  standard  * 

operating  prooedure. 
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